-- Logs begin at Fri 2022-09-02 04:41:40 UTC, end at Fri 2022-09-02 05:45:48 UTC. -- Sep 02 05:14:44.038763 dv-cinder-853910-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 02 05:14:44.048179 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 02 05:14:44.049674 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 2 05:14:44 2022] *** Sep 02 05:14:44.049674 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 02 05:14:44.049674 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 02 05:14:44.049674 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: nodename: dv-cinder-853910-7-iscsi Sep 02 05:14:44.049674 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: machine: x86_64 Sep 02 05:14:44.049674 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: clock source: unix Sep 02 05:14:44.049674 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: pcre jit disabled Sep 02 05:14:44.049674 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: detected number of CPU cores: 4 Sep 02 05:14:44.049674 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: current working directory: / Sep 02 05:14:44.049674 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: detected binary path: /usr/bin/uwsgi-core Sep 02 05:14:44.049674 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: your processes number limit is 47680 Sep 02 05:14:44.049674 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: your memory page size is 4096 bytes Sep 02 05:14:44.049674 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: detected max file descriptor number: 2048 Sep 02 05:14:44.049674 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: lock engine: pthread robust mutexes Sep 02 05:14:44.050673 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: thunder lock: enabled Sep 02 05:14:44.050673 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 02 05:14:44.050673 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 02 05:14:44.088078 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: Python main interpreter initialized at 0x56352fc099c0 Sep 02 05:14:44.088078 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: python threads support enabled Sep 02 05:14:44.088078 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: your server socket listen backlog is limited to 100 connections Sep 02 05:14:44.088078 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: your mercy for graceful operations on workers is 90 seconds Sep 02 05:14:44.088470 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: mapped 403077 bytes (393 KB) for 2 cores Sep 02 05:14:44.088470 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: *** Operational MODE: preforking *** Sep 02 05:14:44.088745 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: *** uWSGI is running in multiple interpreter mode *** Sep 02 05:14:44.088745 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: spawned uWSGI master process (pid: 105460) Sep 02 05:14:44.096747 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: spawned uWSGI worker 1 (pid: 105461, cores: 1) Sep 02 05:14:44.096747 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: spawned uWSGI worker 2 (pid: 105462, cores: 1) Sep 02 05:14:44.096747 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 02 05:14:44.088925 dv-cinder-853910-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 02 05:14:44.729175 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 02 05:14:44.731313 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 02 05:14:45.793622 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 05:14:45.793622 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: from cryptography.utils import int_from_bytes Sep 02 05:14:45.794256 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 05:14:45.794256 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: from cryptography.utils import int_from_bytes Sep 02 05:14:45.797262 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 05:14:45.797262 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: from cryptography.utils import int_from_bytes Sep 02 05:14:45.797739 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 05:14:45.797739 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: from cryptography.utils import int_from_bytes Sep 02 05:14:48.265341 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 05:14:48.266027 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 05:14:48.266127 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 05:14:48.266268 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 05:14:48.266701 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 05:14:48.266794 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 05:14:48.266889 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 05:14:48.266972 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 05:14:48.267062 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.267353 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.267505 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 05:14:48.267601 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 05:14:48.267693 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.267960 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.268105 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.268282 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.268379 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.268618 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.268751 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.268924 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.269056 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.269238 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.269388 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.269508 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.269610 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.269806 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.269948 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.270119 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.270265 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.270441 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853910-7-iscsi {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.270576 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.270673 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.270769 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.270953 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.271067 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.271291 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853910-7-iscsi {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.271436 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.271578 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.271677 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.271896 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.272030 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.272201 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.272296 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.272507 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.272597 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.272802 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.273003 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.273110 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.274186 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.274322 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.274322 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.274555 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.274660 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.274743 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.274821 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.274946 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.275039 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.275165 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.275248 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.275370 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.275454 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.275532 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.275667 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.275758 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.275845 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.275924 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.276103 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.276233 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.276506 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.276603 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853910-7-iscsi {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.276806 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.276906 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.277108 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.277196 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853910-7-iscsi {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.277418 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.277520 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.277758 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.277857 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.278056 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.278161 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.278429 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.278576 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.278776 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.278868 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.279078 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.279177 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.279388 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.279485 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.279710 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.279812 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.280007 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.280137 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.280346 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.280437 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.280654 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.280746 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.280954 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.281044 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.281260 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.281354 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.281548 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.281637 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.281845 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.281937 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.282139 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.282237 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.282441 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.282531 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.282688 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.282781 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.282976 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.283063 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.283228 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.283336 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.283518 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.283619 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.283826 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.283922 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.284155 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.284310 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.284453 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.284613 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.284749 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.284884 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.285031 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.285174 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.285316 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.285408 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.285520 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.285627 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.285817 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.285904 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.286115 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.286204 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.286413 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.286512 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.286709 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.286810 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.287026 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.287166 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.287307 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.287434 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.287601 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.287693 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.287893 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.287979 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.288227 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.288329 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.288533 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.288619 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.288840 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.288925 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.289138 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.289234 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.289446 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.289541 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.289756 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.289849 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.290063 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.290149 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.290359 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.290446 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.290679 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.290764 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.290983 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.291106 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.291287 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.291389 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.291587 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.291676 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.291890 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.291977 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.292204 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.292305 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.292501 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.292588 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.292798 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.292892 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.293106 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.293194 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.293352 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.293448 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.293647 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.293734 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.293932 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.294016 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.294250 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.294400 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.294537 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.294677 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.294816 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.294950 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.295119 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.295271 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.295406 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.295498 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.295698 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.295789 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.295983 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.296078 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.296303 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.296391 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.296599 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.296701 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.296894 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.296990 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.297187 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.297273 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.297480 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.297566 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.297774 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.297861 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.298064 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.298150 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.298358 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.298444 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.298649 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.298736 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.298940 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.299027 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.299246 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.299338 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.299553 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.299640 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.299848 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.299934 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.300159 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.300249 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.300462 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.300558 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.300770 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.300900 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.301053 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.301146 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.301349 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.301438 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.301643 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.301736 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.301938 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.302024 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.302231 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.302327 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.302523 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.302620 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.302822 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.302908 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.303112 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.303198 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.303404 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.303491 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.303702 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.303787 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.303988 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.304083 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.304306 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.304395 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.304610 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.304714 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.304904 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.304990 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.305195 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.305289 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.305486 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.305585 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.305777 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.305862 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.306072 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.306159 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.306362 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.306455 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.306651 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.306742 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.306941 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.307028 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.307228 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.307328 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.307535 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.307622 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.307842 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.307928 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.308152 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.308273 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.308453 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.308556 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.308744 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.308842 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.309051 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:14:48.309149 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.309374 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.309479 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.309756 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.309861 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.310091 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.310187 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.310395 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.310500 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.310716 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.310826 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.311026 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.311122 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.311332 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.311427 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.311634 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.311748 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.311936 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.312032 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.312266 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.312362 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.312570 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.312677 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.312871 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.312969 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.313187 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.313301 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.313482 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.313588 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.313784 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.313884 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.314095 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.314182 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.314400 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.314503 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.314702 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.314797 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.315006 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.315092 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.315305 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.315403 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.315613 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.315712 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.315930 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.316024 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.316258 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.316361 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.316559 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.316647 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.316888 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.316975 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.317220 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.317309 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.317522 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.317619 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.317830 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.317917 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.318135 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.318223 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.318436 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.318530 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.318734 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.318829 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.319034 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.319122 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.319364 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.319452 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.319671 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.319757 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.319973 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.320061 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.320307 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.320400 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.320614 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.320715 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.320926 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.321022 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.321229 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.321324 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.321532 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.321642 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.321835 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.321932 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.322135 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.322232 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.322437 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.322542 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.322762 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.322860 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.323066 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.323162 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.323375 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.323478 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.323677 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.323779 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.323978 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.324075 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.324308 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.324413 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.324612 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.324709 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.324913 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.325017 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.325212 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.325336 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.325535 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.325652 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.325831 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.325924 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.326126 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.326251 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.326462 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.326549 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.326758 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.326854 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.327069 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.327159 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.327387 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.327475 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.327685 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.327779 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.327991 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.328078 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.328321 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.328423 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.328623 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.328723 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.328924 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.329009 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.329221 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.329307 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.329524 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.329618 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.329849 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.329985 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.330122 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.330216 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.330418 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.330517 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.330731 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.330824 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.331027 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.331119 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.331323 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.331423 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.331633 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.331738 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.331923 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.332009 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.332240 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.332333 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.332546 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.332649 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.332848 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.332934 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.333149 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.333236 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.333455 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.333566 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.333754 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.333851 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.334058 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.334154 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.334359 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.334455 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.334659 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.334764 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.334981 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.335077 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.335299 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.335395 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.335594 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.335698 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.335904 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.336001 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.336238 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.336335 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.336544 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.336658 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.336835 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.336982 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.337116 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.337255 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.337414 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.337558 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.337700 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.337840 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.337974 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.338112 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.338266 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.338411 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.338543 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.338678 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.338829 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.338963 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.339124 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.339259 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.339416 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.339550 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.339713 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.339847 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.340015 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.340177 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.340310 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.340442 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.340609 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.340740 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.340921 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.341088 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.341242 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.341371 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.341574 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.341708 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.341871 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.342013 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.342203 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.342345 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.342530 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.342676 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.342824 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.342956 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.343136 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.343278 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.343437 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.343578 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.343741 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.343873 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.344026 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.344194 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.344353 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.344497 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.344654 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.344804 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.344955 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.345115 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.345248 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.345390 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.345551 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.345687 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.345861 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.346020 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.346168 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.346303 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.346461 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.346595 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.346761 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.346893 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.347067 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.347206 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.347361 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.347491 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.347661 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.347803 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.347990 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.348179 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.348319 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.348462 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.348626 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.348769 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.348960 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.349091 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.349223 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.349356 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.349516 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.349652 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.349812 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.349954 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.350111 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.350245 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.350410 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.350548 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.350708 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.350851 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.351013 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.351148 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.351311 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.351454 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.351617 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.351769 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.351901 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.352036 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.352234 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.352380 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.352537 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.352670 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.352844 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.352980 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.353137 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.353281 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.353438 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.353572 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.353755 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.353868 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.354061 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.354154 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.354360 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.354447 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.354662 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.354762 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.354966 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.355062 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.355262 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.355356 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.355560 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.355646 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.355857 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.355952 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.356175 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.356274 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.356470 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.356570 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.356793 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.356882 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.357095 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.357180 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.357394 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.357488 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.357688 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.357773 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.357982 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.358068 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.358281 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.358376 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.358577 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.358663 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.358871 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.358956 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.359167 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.359262 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.359470 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.359557 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.359783 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.359870 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.360082 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.360206 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.360417 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.360514 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.360716 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.360803 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.361010 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.361110 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.361305 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.361391 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.361616 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.361703 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.361918 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.362076 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.362221 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.362361 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.362503 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.362635 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.362780 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.362914 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.363093 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.363230 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.363376 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.363515 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.363658 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.363792 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.363963 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.364094 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.364284 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.364428 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.364567 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.364698 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.364876 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.364972 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.365177 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.365272 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.365478 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.365573 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.365790 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.365887 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.366092 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.366205 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.366395 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.366546 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.366691 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.366827 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.366977 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.367118 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.367269 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.367401 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.367541 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.367675 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.367851 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.367995 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.368157 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.368308 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.368459 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.368590 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.368758 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.368897 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.369044 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.369179 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.369339 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.369630 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.369773 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.369964 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.370200 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.370335 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.370526 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.370667 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.370815 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.370949 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.371127 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.371285 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.371461 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.371606 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.372126 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.372329 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.372572 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.372670 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.372878 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.373026 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.373186 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.373445 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.373546 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.373782 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.373893 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.374173 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.374266 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.374381 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.374685 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.374775 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.374971 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.375079 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.375277 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.375524 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.375620 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.375830 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.375918 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.376161 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.376253 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.376451 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.376601 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.376741 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.376887 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.377020 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.377154 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.377318 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.377452 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.377615 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.377750 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.377894 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.378028 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.378241 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.378387 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.378531 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.378663 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.378795 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.378934 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.379074 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.379206 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.379339 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.379472 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.379637 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.379796 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.379930 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.380063 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.380234 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.380366 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.380519 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.380698 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.381004 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.381257 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.381355 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.381561 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.381650 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.381892 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.381981 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.382258 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.382357 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.382491 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.382589 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.382798 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.382885 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.383102 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.383189 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.383405 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.383507 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.383713 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.383808 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.384018 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.384139 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.384349 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.384590 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.384680 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.384939 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.385133 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.385229 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.385530 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.385666 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.385846 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.386155 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.386240 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.386456 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.386744 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.386920 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.387049 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.387303 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.387390 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.387640 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.387863 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.387959 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.388294 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.388455 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.388609 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.388912 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.389008 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.389213 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.389516 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.389602 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.389824 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.389914 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.390129 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.390220 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.390430 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.390520 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.390744 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.390849 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.391046 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.391134 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.391345 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.391432 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.391647 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.391743 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.391954 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.392277 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.392417 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.392581 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.392857 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.392955 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.393622 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.393737 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.393829 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.393911 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.394039 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.394134 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.394217 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.394342 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.394450 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.394537 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.394668 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.394855 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.394944 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.395145 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.395235 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.395445 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.395543 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.395766 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.395855 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.396096 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.396297 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.396419 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.396517 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.396721 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.396808 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.397024 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.397110 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.397822 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.397941 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.397941 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.398093 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.398172 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.398252 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.398339 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.398520 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.398652 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.398820 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.399177 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.399264 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.399479 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.399762 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.399857 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.400090 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.400365 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.400456 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.400716 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.400862 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.401025 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.401113 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.401326 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.401414 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.401637 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.401726 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.401935 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.402028 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.402235 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.402322 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.402533 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.402621 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.402830 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.402916 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.403145 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.403240 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.403504 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.403596 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.403815 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.403904 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.404175 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.404281 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.404462 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.404550 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.404768 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.404882 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.405071 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.405182 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.405378 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.405467 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.405692 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.405781 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.405997 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.406094 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.406305 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.406409 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.406607 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.406694 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.406915 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.407048 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.407222 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.407472 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.407559 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.407821 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.407916 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.408137 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.408344 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.408453 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.408759 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.408846 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.409065 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.409165 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.409367 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.409585 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.409671 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.409977 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.410072 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.410277 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.410371 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.410580 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.410667 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.410887 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.411038 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.411193 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.411334 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.411477 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.411726 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.411908 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.412182 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.412275 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.412538 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.412686 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.412823 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.413042 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.413180 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.413420 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.413560 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.413731 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.413866 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.414039 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.414220 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.414367 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.414519 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.414737 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.414838 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.415043 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.415177 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.415349 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.415598 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.415684 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.415945 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.416040 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.416268 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.416469 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.416560 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.416881 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.416985 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.417182 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.417293 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.417483 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.417710 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.417798 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.418090 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.418184 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.418392 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.418479 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.418711 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.418808 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.419030 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.419144 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.419413 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.419500 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.419716 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.419811 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.420014 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.420155 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.420345 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.420468 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.420646 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.420774 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.421068 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.421174 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.421372 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.421469 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.421674 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.421770 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.421969 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.422057 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.422271 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.422366 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.422573 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.422662 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.422879 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.422966 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.423182 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.423269 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.423481 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.423568 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.423786 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.423872 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.424087 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.424187 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.424449 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.424541 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.424767 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.424854 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.425064 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.425155 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.425357 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.425459 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.425655 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.425779 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.425968 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.426099 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.426262 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.426409 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.426555 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.426727 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.426840 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.427053 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.427141 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.427355 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.427444 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.427656 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.427743 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.427960 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.428159 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.428287 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.428459 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.428589 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.428756 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.428907 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.429159 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.429257 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.429458 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.429547 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.429759 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.429845 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.430079 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.430174 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.430379 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.430466 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.430681 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.430767 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.430976 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.431079 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.431280 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.431379 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.431577 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.431673 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.431888 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.431977 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.432231 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.432319 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.432537 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.432637 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.432841 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.432929 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.433134 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.433220 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.433447 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.433535 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.433749 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.433844 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.434046 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.434141 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.434343 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.434438 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.434729 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.434870 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.435038 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.435126 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.435358 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.435458 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.435680 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.435768 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.435998 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.436086 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.436321 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.436423 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.436618 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.436707 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.436920 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.437007 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.437214 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.437313 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.437508 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.437596 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.437818 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.437912 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.438113 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.438201 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.438414 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.438501 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.438713 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.438801 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.439012 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.439100 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.439307 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.439394 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.439601 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.439687 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.439903 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.440000 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.440234 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.440330 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.440535 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.440634 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.440842 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.440974 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.441140 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.441241 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.441453 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.441559 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.441746 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.441836 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.442056 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.442143 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.442356 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.442458 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.442778 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.442874 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.442986 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.443075 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.443281 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.443379 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.443614 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.443703 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.443909 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.443997 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.444246 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.444356 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.444557 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.444646 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.444882 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.445033 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.445175 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.445311 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.445489 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.445630 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.445799 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.445933 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.446146 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.446280 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.446414 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.446571 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.446690 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.446863 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.447005 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.447139 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.447293 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.447427 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.447560 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.447703 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.447847 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.447980 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.448174 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.448265 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.448472 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.448725 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.448816 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.449049 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.449141 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.449343 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.449437 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.449638 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.449737 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.449940 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.450026 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.450249 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.450372 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.450565 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.450653 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.450875 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.450961 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.451171 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.451258 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.451465 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.451565 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.451756 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.451894 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.452048 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.452292 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.452404 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.452656 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.452745 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.452989 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.453086 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.453288 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.453375 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.453602 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.453690 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.453907 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.453994 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.454210 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.454298 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.454514 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.454615 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.454818 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.454914 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.455119 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.455210 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.455422 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.455509 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.455724 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.455888 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.456021 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.456111 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.456349 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.456436 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.456652 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.456751 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.456958 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.457060 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.457266 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.457493 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.457589 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.457818 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.457912 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.458126 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.458213 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.458429 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.458525 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.458733 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.458821 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.459035 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.459130 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.459335 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.459432 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.459635 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.459729 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.459946 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.460033 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.460268 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.460358 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.460570 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.460656 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.460887 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.461111 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.461221 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.461426 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.461536 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.461763 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.461861 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.462084 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.462191 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.462401 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.462487 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.462704 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.462791 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.463008 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.463097 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.463331 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.463426 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.463637 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.463733 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.463931 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.464018 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.464260 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.464366 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.464567 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.464728 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.464867 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.464963 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.465169 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.465263 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.465471 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.465567 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.465774 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.465860 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.466140 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.466247 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.466448 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.466546 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.466749 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.466974 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.467063 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.467325 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.467421 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.467638 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.467728 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.467960 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.468053 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.468295 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.468398 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.468600 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.468688 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.468901 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.468989 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.469204 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.469301 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.469509 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.469707 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.469815 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.470014 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.470129 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.470342 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.470431 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.470658 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.470746 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.470973 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.471060 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.471282 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.471378 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.471588 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.471674 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.471889 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.471998 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.472213 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.472305 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.472511 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.472613 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.472813 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.472910 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.473112 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.473200 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.473408 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.473504 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.473708 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.473804 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.474008 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.474102 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.474302 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.474390 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.474599 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.474693 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.474897 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.474985 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.475194 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.475417 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.475513 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.475758 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.475845 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.476065 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.476165 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.476402 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.476501 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.476707 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.476801 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.477012 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.477099 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.477311 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.477407 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.477623 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.477713 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.477919 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.478027 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.478213 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.478353 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.478518 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.478658 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.478820 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.478974 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.479117 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.479283 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.479410 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.479605 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.479700 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.479914 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.480009 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.480246 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.480339 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.480594 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.480681 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.480885 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.480982 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.481203 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.481419 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.481506 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.481780 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.481891 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.482087 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.482192 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.482384 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.482472 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.482677 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.482772 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.482970 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.483058 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.483267 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.483354 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.483560 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.483656 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.483859 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.483955 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.484177 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.484278 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.484479 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.484577 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.484775 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.484863 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.485073 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.485161 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.485392 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.485530 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.485702 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.485797 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.485994 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.486081 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.486300 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.486388 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.486593 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.486686 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.486887 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.486990 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.487191 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.487280 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.487491 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.487577 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.487794 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.487880 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.488096 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.488218 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.488416 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.488503 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.488751 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.488849 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.489053 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.489139 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.489366 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.489571 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.489681 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.489906 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.490004 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.490219 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.490307 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.490544 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.490631 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.490866 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.490955 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.491165 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.491252 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.491460 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.491560 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.491758 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.491855 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.492088 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.492262 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.492397 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.492496 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.492700 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.492875 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.492999 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.493183 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.493299 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.493502 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.493591 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.493823 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.493918 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.494130 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.494231 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.494449 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.494536 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.494745 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.494832 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.495042 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.495142 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.495339 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.495463 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.495636 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.495724 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.495933 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.496388 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.496504 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.496593 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.496673 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.497118 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.497307 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.497410 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.497624 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.497713 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.497925 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.498019 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.498227 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.498323 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.498532 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.498618 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.498833 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.498919 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.499133 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.499221 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.499430 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.499515 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.499731 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.499819 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.500033 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.500149 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.500356 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.500455 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.500656 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.500758 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.500950 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.501037 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.501247 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.501344 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.501555 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.501657 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.501853 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.501941 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.502155 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.502242 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.502457 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.502562 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.502760 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.502851 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.503057 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.503144 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.503356 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.503452 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.503662 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.503750 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.503964 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.504050 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.504300 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.504400 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.504603 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.504690 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.504898 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.505013 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.505196 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.505290 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.505528 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.505615 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.505822 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.505908 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.506116 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.506213 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.506415 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.506503 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.506724 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.506819 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.507025 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.507113 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.507317 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.507450 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.507610 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.507708 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.507909 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.507996 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.508224 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.508316 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.508519 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.508620 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.508813 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.508902 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.509106 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.509192 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.509402 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.509498 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.509700 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.509787 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.510002 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.510096 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.510286 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.510374 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.510580 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.510666 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.510873 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.510959 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.511165 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.511267 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.511464 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.511588 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.511756 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.511866 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.512046 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.512221 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.512357 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.512538 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.512645 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.512878 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.512967 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.513189 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.513275 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.513516 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.513604 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.513823 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.513912 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.514131 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.514220 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.514438 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.514525 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.514756 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.514845 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.515055 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.515142 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.515413 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.515506 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.515671 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.515766 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.515971 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.516063 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.516292 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.516397 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.516608 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.516703 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.516906 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.517000 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.517207 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.517304 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.517504 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.517591 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.517805 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.517893 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.518107 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.518207 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.518403 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.518499 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.518721 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.518808 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.519036 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.519126 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.519330 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.519424 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.519652 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.519749 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.519960 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.520052 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.520292 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.520384 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.520540 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 05:14:48.520628 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.520886 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.521202 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.521500 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.521798 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.522097 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.522396 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.522698 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.523001 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.523300 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.523597 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.523900 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.524222 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.524538 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.524851 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.525148 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.525462 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.525776 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.526112 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.526411 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.526741 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.527057 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.527363 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.527666 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.527956 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:14:48.528211 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 05:14:48.676288 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO dbcounter [None req-dac9312d-486d-468d-bb7b-18c6a5d138d4 None None] Registered counter for database nova_api Sep 02 05:14:48.683397 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO dbcounter [None req-4a492619-ca68-41b3-8b19-efb37bc635de None None] Registered counter for database nova_api Sep 02 05:14:48.697367 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG oslo_db.sqlalchemy.engines [None req-dac9312d-486d-468d-bb7b-18c6a5d138d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 05:14:48.704086 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writer thread running {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 05:14:48.704565 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_db.sqlalchemy.engines [None req-4a492619-ca68-41b3-8b19-efb37bc635de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 05:14:48.710934 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writer thread running {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 05:14:48.761175 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.context [None req-dac9312d-486d-468d-bb7b-18c6a5d138d4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),90ca4909-2326-46fd-b0af-6442bf8c1fe3(cell1) {{(pid=105461) load_cells /opt/stack/nova/nova/context.py:464}} Sep 02 05:14:48.765146 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-dac9312d-486d-468d-bb7b-18c6a5d138d4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:14:48.765683 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-dac9312d-486d-468d-bb7b-18c6a5d138d4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:14:48.766696 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.context [None req-4a492619-ca68-41b3-8b19-efb37bc635de None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),90ca4909-2326-46fd-b0af-6442bf8c1fe3(cell1) {{(pid=105462) load_cells /opt/stack/nova/nova/context.py:464}} Sep 02 05:14:48.767189 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-dac9312d-486d-468d-bb7b-18c6a5d138d4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:14:48.767926 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-dac9312d-486d-468d-bb7b-18c6a5d138d4 None None] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:14:48.768395 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-dac9312d-486d-468d-bb7b-18c6a5d138d4 None None] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:14:48.770361 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-dac9312d-486d-468d-bb7b-18c6a5d138d4 None None] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:14:48.770516 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-4a492619-ca68-41b3-8b19-efb37bc635de None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:14:48.771002 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-4a492619-ca68-41b3-8b19-efb37bc635de None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:14:48.772370 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO dbcounter [None req-dac9312d-486d-468d-bb7b-18c6a5d138d4 None None] Registered counter for database nova_cell0 Sep 02 05:14:48.772539 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-4a492619-ca68-41b3-8b19-efb37bc635de None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:14:48.773290 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-4a492619-ca68-41b3-8b19-efb37bc635de None None] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:14:48.773727 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-4a492619-ca68-41b3-8b19-efb37bc635de None None] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:14:48.775763 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-4a492619-ca68-41b3-8b19-efb37bc635de None None] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:14:48.776371 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO dbcounter [None req-dac9312d-486d-468d-bb7b-18c6a5d138d4 None None] Registered counter for database nova_cell1 Sep 02 05:14:48.777747 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO dbcounter [None req-4a492619-ca68-41b3-8b19-efb37bc635de None None] Registered counter for database nova_cell0 Sep 02 05:14:48.781782 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO dbcounter [None req-4a492619-ca68-41b3-8b19-efb37bc635de None None] Registered counter for database nova_cell1 Sep 02 05:14:48.784285 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG oslo_db.sqlalchemy.engines [None req-dac9312d-486d-468d-bb7b-18c6a5d138d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 05:14:48.785940 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG oslo_db.sqlalchemy.engines [None req-dac9312d-486d-468d-bb7b-18c6a5d138d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 05:14:48.788530 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_db.sqlalchemy.engines [None req-4a492619-ca68-41b3-8b19-efb37bc635de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 05:14:48.792176 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writer thread running {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 05:14:48.793905 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writer thread running {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 05:14:48.794217 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writer thread running {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 05:14:48.928611 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_db.sqlalchemy.engines [None req-4a492619-ca68-41b3-8b19-efb37bc635de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 05:14:48.934344 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writer thread running {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 05:14:48.936312 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO dbcounter [None req-dac9312d-486d-468d-bb7b-18c6a5d138d4 None None] Registered counter for database nova_cell0 Sep 02 05:14:48.943398 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO dbcounter [None req-4a492619-ca68-41b3-8b19-efb37bc635de None None] Registered counter for database nova_cell0 Sep 02 05:14:48.945404 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG oslo_db.sqlalchemy.engines [None req-dac9312d-486d-468d-bb7b-18c6a5d138d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 05:14:48.950811 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writer thread running {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 05:14:48.952436 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_db.sqlalchemy.engines [None req-4a492619-ca68-41b3-8b19-efb37bc635de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 05:14:48.957523 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writer thread running {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 05:14:49.282238 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: WARNING keystonemiddleware.auth_token [None req-4a492619-ca68-41b3-8b19-efb37bc635de None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 05:14:49.286788 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: WARNING keystonemiddleware.auth_token [None req-dac9312d-486d-468d-bb7b-18c6a5d138d4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 05:14:49.289522 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: WARNING keystonemiddleware.auth_token [None req-4a492619-ca68-41b3-8b19-efb37bc635de None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 05:14:49.294051 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: WARNING keystonemiddleware.auth_token [None req-dac9312d-486d-468d-bb7b-18c6a5d138d4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 05:14:49.625589 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: WARNING keystonemiddleware.auth_token [None req-4a492619-ca68-41b3-8b19-efb37bc635de None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 05:14:49.631556 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: WARNING keystonemiddleware.auth_token [None req-4a492619-ca68-41b3-8b19-efb37bc635de None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 05:14:49.632262 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: WARNING keystonemiddleware.auth_token [None req-dac9312d-486d-468d-bb7b-18c6a5d138d4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 05:14:49.636883 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56352fc099c0 pid: 105462 (default app) Sep 02 05:14:49.638217 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: WARNING keystonemiddleware.auth_token [None req-dac9312d-486d-468d-bb7b-18c6a5d138d4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 05:14:49.639024 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-4a492619-ca68-41b3-8b19-efb37bc635de None None] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:14:49.640233 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-4a492619-ca68-41b3-8b19-efb37bc635de None None] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001724 Sep 02 05:14:49.640641 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 788 bytes} [Fri Sep 2 05:14:49 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:14:49.643491 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56352fc099c0 pid: 105461 (default app) Sep 02 05:16:07.180542 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-4a492619-ca68-41b3-8b19-efb37bc635de None None] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:16:07.181570 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-4a492619-ca68-41b3-8b19-efb37bc635de None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Sep 02 05:16:07.182149 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 2/2] 10.222.0.30 () {54 vars in 931 bytes} [Fri Sep 2 05:16:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:16:07.194461 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writing DB stats nova_api:SELECT=3 {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:07.195409 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writing DB stats nova_cell0:SELECT=3 {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:07.196421 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writing DB stats nova_cell1:SELECT=3 {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:07.197412 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:08.041134 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-fb1fda40-e14b-4701-8fca-d74934bf42c5 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:16:08.076008 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-fb1fda40-e14b-4701-8fca-d74934bf42c5 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.886642 Sep 02 05:16:08.076833 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 1/3] 10.222.0.30 () {60 vars in 1292 bytes} [Fri Sep 2 05:16:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:16:10.392613 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-4a492619-ca68-41b3-8b19-efb37bc635de None None] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:16:10.393618 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-4a492619-ca68-41b3-8b19-efb37bc635de None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Sep 02 05:16:10.394206 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 3/4] 10.222.0.30 () {54 vars in 931 bytes} [Fri Sep 2 05:16:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:16:10.837048 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-b71cc463-60e6-4528-b1dc-680b4fbe88e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "name": "cirros256", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "ram": 256}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:16:10.885484 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-b71cc463-60e6-4528-b1dc-680b4fbe88e5 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.485292 Sep 02 05:16:10.886278 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 2/5] 10.222.0.30 () {64 vars in 1283 bytes} [Fri Sep 2 05:16:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 05:16:10.899726 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writing DB stats nova_api:SELECT=3 {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:10.900860 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writing DB stats nova_cell0:SELECT=3 {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:10.901656 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writing DB stats nova_cell1:SELECT=3 {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:10.902734 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:11.113302 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-a360a416-0874-4762-aefe-1693b410c1b9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:16:11.176510 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-a360a416-0874-4762-aefe-1693b410c1b9 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.281864 Sep 02 05:16:11.177671 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 4/6] 10.222.0.30 () {64 vars in 1336 bytes} [Fri Sep 2 05:16:10 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:16:13.542197 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-b71cc463-60e6-4528-b1dc-680b4fbe88e5 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:16:13.543258 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-b71cc463-60e6-4528-b1dc-680b4fbe88e5 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001635 Sep 02 05:16:13.543866 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 3/7] 10.222.0.30 () {54 vars in 931 bytes} [Fri Sep 2 05:16:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:16:14.196146 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-5c85f92a-3cf6-4555-86d9-5b5c96e65173 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "swap": 0, "id": "d1", "ram": 512}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:16:14.236489 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-5c85f92a-3cf6-4555-86d9-5b5c96e65173 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.686055 Sep 02 05:16:14.237142 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 5/8] 10.222.0.30 () {64 vars in 1283 bytes} [Fri Sep 2 05:16:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 05:16:14.249626 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-dfdb588b-ffd4-4a1e-af5b-0ce503e7a07f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:16:14.285529 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-dfdb588b-ffd4-4a1e-af5b-0ce503e7a07f admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039958 Sep 02 05:16:14.286192 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 4/9] 10.222.0.30 () {64 vars in 1336 bytes} [Fri Sep 2 05:16:14 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:16:16.613462 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-5c85f92a-3cf6-4555-86d9-5b5c96e65173 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:16:16.614462 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-5c85f92a-3cf6-4555-86d9-5b5c96e65173 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 02 05:16:16.614853 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 6/10] 10.222.0.30 () {54 vars in 931 bytes} [Fri Sep 2 05:16:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:16:16.979371 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-23c1b1ff-1724-43f3-836f-6c535051031c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "os-flavor-access:is_public": true, "swap": 0, "ram": 1024, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:16:16.998857 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-23c1b1ff-1724-43f3-836f-6c535051031c admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.377602 Sep 02 05:16:16.999385 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 5/11] 10.222.0.30 () {64 vars in 1283 bytes} [Fri Sep 2 05:16:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 05:16:17.011868 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-c845db29-c25f-4f0e-94b9-5932bd94c95e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:16:17.036398 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-c845db29-c25f-4f0e-94b9-5932bd94c95e admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028521 Sep 02 05:16:17.036958 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 7/12] 10.222.0.30 () {64 vars in 1336 bytes} [Fri Sep 2 05:16:17 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:16:19.327138 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-23c1b1ff-1724-43f3-836f-6c535051031c admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:16:19.328052 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-23c1b1ff-1724-43f3-836f-6c535051031c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Sep 02 05:16:19.328483 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 6/13] 10.222.0.30 () {54 vars in 931 bytes} [Fri Sep 2 05:16:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:16:19.804787 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-ef67437a-7a36-4e9f-ae45-0b8817d899e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "rxtx_factor": 1.0, "ram": 2048, "name": "ds2G", "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:16:19.825864 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-ef67437a-7a36-4e9f-ae45-0b8817d899e8 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.491409 Sep 02 05:16:19.828184 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 8/14] 10.222.0.30 () {64 vars in 1283 bytes} [Fri Sep 2 05:16:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 05:16:19.838830 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-146f5776-6bfa-4198-abcf-29f91e549b8b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:16:19.863476 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-146f5776-6bfa-4198-abcf-29f91e549b8b admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028454 Sep 02 05:16:19.864042 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 7/15] 10.222.0.30 () {64 vars in 1336 bytes} [Fri Sep 2 05:16:19 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:16:22.171811 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-ef67437a-7a36-4e9f-ae45-0b8817d899e8 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:16:22.172853 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-ef67437a-7a36-4e9f-ae45-0b8817d899e8 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Sep 02 05:16:22.173479 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 9/16] 10.222.0.30 () {54 vars in 931 bytes} [Fri Sep 2 05:16:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:16:22.609667 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-5e0ce87f-0fc9-4cde-a216-30dbc991b9f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 4096, "swap": 0, "id": "d4"}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:16:22.631854 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-5e0ce87f-0fc9-4cde-a216-30dbc991b9f5 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.451749 Sep 02 05:16:22.632677 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 8/17] 10.222.0.30 () {64 vars in 1283 bytes} [Fri Sep 2 05:16:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 05:16:22.645632 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-31917198-ba63-4b6d-8ad0-d04aa8d4b973 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:16:22.672190 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-31917198-ba63-4b6d-8ad0-d04aa8d4b973 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030751 Sep 02 05:16:22.688147 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 10/18] 10.222.0.30 () {64 vars in 1336 bytes} [Fri Sep 2 05:16:22 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:16:25.013131 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-5e0ce87f-0fc9-4cde-a216-30dbc991b9f5 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:16:25.014184 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-5e0ce87f-0fc9-4cde-a216-30dbc991b9f5 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Sep 02 05:16:25.014564 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 9/19] 10.222.0.30 () {54 vars in 931 bytes} [Fri Sep 2 05:16:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:16:25.467672 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-8651b3c6-73ad-459e-8041-6caaa89eafa2 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:16:25.493062 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-8651b3c6-73ad-459e-8041-6caaa89eafa2 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.470632 Sep 02 05:16:25.493622 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 11/20] 10.222.0.30 () {60 vars in 1292 bytes} [Fri Sep 2 05:16:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:16:28.070174 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-5e0ce87f-0fc9-4cde-a216-30dbc991b9f5 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:16:28.071525 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-5e0ce87f-0fc9-4cde-a216-30dbc991b9f5 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001877 Sep 02 05:16:28.071977 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 10/21] 10.222.0.30 () {54 vars in 931 bytes} [Fri Sep 2 05:16:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 05:16:28.515485 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-80477ea0-29cf-45ef-8ca1-19ba48a15432 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "name": "m1.tiny", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:16:28.556069 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-80477ea0-29cf-45ef-8ca1-19ba48a15432 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.477161 Sep 02 05:16:28.557084 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 12/22] 10.222.0.30 () {64 vars in 1283 bytes} [Fri Sep 2 05:16:28 2022] POST /compute/v2.1/flavors => generated 402 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 05:16:28.570863 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-a12e7580-9fca-4d55-904a-9c15265a1350 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:16:28.600170 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-a12e7580-9fca-4d55-904a-9c15265a1350 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034221 Sep 02 05:16:28.600672 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 11/23] 10.222.0.30 () {64 vars in 1333 bytes} [Fri Sep 2 05:16:28 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:16:30.873056 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-80477ea0-29cf-45ef-8ca1-19ba48a15432 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:16:30.874128 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-80477ea0-29cf-45ef-8ca1-19ba48a15432 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 02 05:16:30.874519 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 931 bytes} [Fri Sep 2 05:16:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:16:31.265031 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-7cb1993f-211e-4b52-b06f-2c1f1041f89a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "vcpus": 1, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small"}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:16:31.285143 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-7cb1993f-211e-4b52-b06f-2c1f1041f89a admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.404232 Sep 02 05:16:31.285671 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 12/25] 10.222.0.30 () {64 vars in 1283 bytes} [Fri Sep 2 05:16:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 05:16:31.297970 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-f0bb258c-97c3-46a5-965a-c656e7d287f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:16:31.324593 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-f0bb258c-97c3-46a5-965a-c656e7d287f2 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030228 Sep 02 05:16:31.325161 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 14/26] 10.222.0.30 () {64 vars in 1333 bytes} [Fri Sep 2 05:16:31 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:16:33.659275 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-7cb1993f-211e-4b52-b06f-2c1f1041f89a admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:16:33.660982 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-7cb1993f-211e-4b52-b06f-2c1f1041f89a admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002141 Sep 02 05:16:33.661417 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 13/27] 10.222.0.30 () {54 vars in 931 bytes} [Fri Sep 2 05:16:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:16:34.069475 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-de4ded71-9ee8-4b17-8b23-a89b40ecfbb5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 40, "ram": 4096, "name": "m1.medium", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "3", "swap": 0}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:16:34.088873 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-de4ded71-9ee8-4b17-8b23-a89b40ecfbb5 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.421119 Sep 02 05:16:34.089815 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 15/28] 10.222.0.30 () {64 vars in 1283 bytes} [Fri Sep 2 05:16:33 2022] POST /compute/v2.1/flavors => generated 406 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 05:16:34.102032 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-a3efa8e3-27c3-4937-b6ef-285593fedfda admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:16:34.129523 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-a3efa8e3-27c3-4937-b6ef-285593fedfda admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031355 Sep 02 05:16:34.130453 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 14/29] 10.222.0.30 () {64 vars in 1333 bytes} [Fri Sep 2 05:16:34 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:16:36.514233 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-de4ded71-9ee8-4b17-8b23-a89b40ecfbb5 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:16:36.515267 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-de4ded71-9ee8-4b17-8b23-a89b40ecfbb5 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Sep 02 05:16:36.516288 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 16/30] 10.222.0.30 () {54 vars in 931 bytes} [Fri Sep 2 05:16:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:16:36.959898 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-4b86a490-d5f4-4ac4-89ac-96859f8f679e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "swap": 0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "os-flavor-access:is_public": true, "id": "4", "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:16:36.980270 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-4b86a490-d5f4-4ac4-89ac-96859f8f679e admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.458021 Sep 02 05:16:36.981432 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 15/31] 10.222.0.30 () {64 vars in 1283 bytes} [Fri Sep 2 05:16:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 05:16:36.994707 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-7fbfaba8-3334-42c9-bead-195a146587ba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:16:37.020443 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-7fbfaba8-3334-42c9-bead-195a146587ba admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030605 Sep 02 05:16:37.021368 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 17/32] 10.222.0.30 () {64 vars in 1333 bytes} [Fri Sep 2 05:16:36 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:16:39.373889 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-4b86a490-d5f4-4ac4-89ac-96859f8f679e admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:16:39.375356 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-4b86a490-d5f4-4ac4-89ac-96859f8f679e admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002244 Sep 02 05:16:39.375946 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 16/33] 10.222.0.30 () {54 vars in 931 bytes} [Fri Sep 2 05:16:39 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:16:39.811443 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-4563cfcd-56a8-494d-9f14-07e64661ea5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "rxtx_factor": 1.0, "swap": 0, "ram": 16384, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "name": "m1.xlarge", "os-flavor-access:is_public": true}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:16:39.831190 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-4563cfcd-56a8-494d-9f14-07e64661ea5e admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.448706 Sep 02 05:16:39.831828 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 18/34] 10.222.0.30 () {64 vars in 1283 bytes} [Fri Sep 2 05:16:39 2022] POST /compute/v2.1/flavors => generated 408 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 05:16:39.843955 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-aba97d75-9ca9-4b3d-a732-5268319782fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:16:39.854572 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:39.875129 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-aba97d75-9ca9-4b3d-a732-5268319782fe admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034882 Sep 02 05:16:39.875708 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 17/35] 10.222.0.30 () {64 vars in 1333 bytes} [Fri Sep 2 05:16:39 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:16:58.537158 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-4563cfcd-56a8-494d-9f14-07e64661ea5e admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:16:58.538166 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-4563cfcd-56a8-494d-9f14-07e64661ea5e admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 02 05:16:58.538575 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 19/36] 10.222.0.30 () {54 vars in 931 bytes} [Fri Sep 2 05:16:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:16:58.959800 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-66cf7a30-3c5d-4808-8c2b-8732570a5e82 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:16:58.985671 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-66cf7a30-3c5d-4808-8c2b-8732570a5e82 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.440226 Sep 02 05:16:58.986200 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 18/37] 10.222.0.30 () {60 vars in 1292 bytes} [Fri Sep 2 05:16:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:17:00.049774 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-4563cfcd-56a8-494d-9f14-07e64661ea5e admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:17:00.050777 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-4563cfcd-56a8-494d-9f14-07e64661ea5e admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Sep 02 05:17:00.051167 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 20/38] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Sep 2 05:17:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:17:00.604100 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-29b09114-1a18-4834-be4c-c87bc7f5cb23 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:17:00.610575 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.wsgi [None req-29b09114-1a18-4834-be4c-c87bc7f5cb23 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 02 05:17:00.613801 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-29b09114-1a18-4834-be4c-c87bc7f5cb23 admin admin] Request method failure captured: Sep 02 05:17:00.613801 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 02 05:17:00.613801 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: Accept: application/json Sep 02 05:17:00.613801 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: Accept-Encoding: gzip, deflate Sep 02 05:17:00.613801 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: Connection: keep-alive Sep 02 05:17:00.613801 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: Content-Length: 0 Sep 02 05:17:00.613801 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: Host: 10.222.0.30 Sep 02 05:17:00.613801 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: Openstack-Api-Version: compute 2.92 Sep 02 05:17:00.613801 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: Openstack-System-Scope: None Sep 02 05:17:00.613801 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: User-Agent: python-novaclient Sep 02 05:17:00.613801 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Auth-Token: gAAAAABjEZHLGmz390H_03LEDSGy7ap8RDydIcmDo6HREy0SYxUGMXUzTs9bGmBTjz9UliMh0yjqkSFMoDNaqV3Fn-qLMLlLXUYLn-e9731I-UTo7vtVJLZAucaa2FuH7j-f_y2t0b3rdpZt-vGZSdcJ7i3tIwzxPwV4WU2_5YYAwpHMyunhpfk Sep 02 05:17:00.613801 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Domain-Id: None Sep 02 05:17:00.613801 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Domain-Name: None Sep 02 05:17:00.613801 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Identity-Status: Confirmed Sep 02 05:17:00.613801 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Is-Admin-Project: True Sep 02 05:17:00.613801 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Openstack-Nova-Api-Version: 2.92 Sep 02 05:17:00.613801 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Project-Domain-Id: default Sep 02 05:17:00.613801 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Project-Domain-Name: Default Sep 02 05:17:00.613801 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Project-Id: e230a9d8be454e00a60613fc9409a9a4 Sep 02 05:17:00.613801 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Project-Name: admin Sep 02 05:17:00.613801 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Role: member,admin,reader Sep 02 05:17:00.613801 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Roles: member,admin,reader Sep 02 05:17:00.615259 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e230a9d8be454e00a60613fc9409a9a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e230a9d8be454e00a60613fc9409a9a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e230a9d8be454e00a60613fc9409a9a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e230a9d8be454e00a60613fc9409a9a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:17:00.615259 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Tenant: admin Sep 02 05:17:00.615259 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Tenant-Id: e230a9d8be454e00a60613fc9409a9a4 Sep 02 05:17:00.615259 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Tenant-Name: admin Sep 02 05:17:00.615259 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-User: admin Sep 02 05:17:00.615259 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-User-Domain-Id: default Sep 02 05:17:00.615259 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-User-Domain-Name: Default Sep 02 05:17:00.615259 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-User-Id: f34e91012b144a309a3b1548fa885905 Sep 02 05:17:00.615259 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-User-Name: admin Sep 02 05:17:00.615259 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: method: > Sep 02 05:17:00.615259 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: exception: Flavor 42 could not be found. Sep 02 05:17:00.615259 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: action_args: {'id': '42'} Sep 02 05:17:00.615259 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:17:00.615259 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:17:00.616227 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 02 05:17:00.616227 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 02 05:17:00.616227 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 02 05:17:00.616227 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 02 05:17:00.616227 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 05:17:00.616227 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 05:17:00.616227 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 02 05:17:00.616227 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 02 05:17:00.616227 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 02 05:17:00.616227 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:17:00.616227 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 02 05:17:00.616227 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 02 05:17:00.616227 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 02 05:17:00.616227 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Sep 02 05:17:00.616227 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:17:00.616227 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Sep 02 05:17:00.616227 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:17:00.616227 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:17:00.616227 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:17:00.617463 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:17:00.617463 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:17:00.617463 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:17:00.617463 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:17:00.617463 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 02 05:17:00.617463 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:17:00.617463 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 02 05:17:00.617463 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Sep 02 05:17:00.617463 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:17:00.617463 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Sep 02 05:17:00.617463 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:17:00.617463 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:17:00.617463 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:17:00.617463 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:17:00.617463 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:17:00.617463 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 02 05:17:00.617463 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Sep 02 05:17:00.617463 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-29b09114-1a18-4834-be4c-c87bc7f5cb23 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:17:00.618754 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-29b09114-1a18-4834-be4c-c87bc7f5cb23 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.430623 Sep 02 05:17:00.618754 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 19/39] 10.222.0.30 () {60 vars in 1190 bytes} [Fri Sep 2 05:17:00 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 432 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 05:17:00.625635 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-0a70c68c-6e2e-46f6-9be3-0bc24328df5b admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:17:00.629942 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:00.656728 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-0a70c68c-6e2e-46f6-9be3-0bc24328df5b admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.034667 Sep 02 05:17:00.657274 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 21/40] 10.222.0.30 () {60 vars in 1210 bytes} [Fri Sep 2 05:17:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:17:00.667254 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-240def0e-e39b-4530-91c6-06e76a0395ca admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:17:00.690133 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-240def0e-e39b-4530-91c6-06e76a0395ca admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026465 Sep 02 05:17:00.690702 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1210 bytes} [Fri Sep 2 05:17:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:17:00.700430 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-855fd3b7-e55b-4b59-aee7-508cbcd5c707 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:17:00.707095 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.wsgi [None req-855fd3b7-e55b-4b59-aee7-508cbcd5c707 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 02 05:17:00.710431 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-855fd3b7-e55b-4b59-aee7-508cbcd5c707 admin admin] Request method failure captured: Sep 02 05:17:00.710431 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 02 05:17:00.710431 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: Accept: application/json Sep 02 05:17:00.710431 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: Accept-Encoding: gzip, deflate Sep 02 05:17:00.710431 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: Connection: keep-alive Sep 02 05:17:00.710431 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: Content-Length: 0 Sep 02 05:17:00.710431 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: Host: 10.222.0.30 Sep 02 05:17:00.710431 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: Openstack-Api-Version: compute 2.92 Sep 02 05:17:00.710431 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: Openstack-System-Scope: None Sep 02 05:17:00.710431 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: User-Agent: python-novaclient Sep 02 05:17:00.710431 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Auth-Token: gAAAAABjEZHLGmz390H_03LEDSGy7ap8RDydIcmDo6HREy0SYxUGMXUzTs9bGmBTjz9UliMh0yjqkSFMoDNaqV3Fn-qLMLlLXUYLn-e9731I-UTo7vtVJLZAucaa2FuH7j-f_y2t0b3rdpZt-vGZSdcJ7i3tIwzxPwV4WU2_5YYAwpHMyunhpfk Sep 02 05:17:00.710431 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Domain-Id: None Sep 02 05:17:00.710431 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Domain-Name: None Sep 02 05:17:00.710431 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Identity-Status: Confirmed Sep 02 05:17:00.710431 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Is-Admin-Project: True Sep 02 05:17:00.710431 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Openstack-Nova-Api-Version: 2.92 Sep 02 05:17:00.710431 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Project-Domain-Id: default Sep 02 05:17:00.710431 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Project-Domain-Name: Default Sep 02 05:17:00.710431 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Project-Id: e230a9d8be454e00a60613fc9409a9a4 Sep 02 05:17:00.710431 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Project-Name: admin Sep 02 05:17:00.710431 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Role: member,admin,reader Sep 02 05:17:00.710431 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Roles: member,admin,reader Sep 02 05:17:00.711888 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e230a9d8be454e00a60613fc9409a9a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e230a9d8be454e00a60613fc9409a9a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e230a9d8be454e00a60613fc9409a9a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e230a9d8be454e00a60613fc9409a9a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:17:00.711888 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Tenant: admin Sep 02 05:17:00.711888 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Tenant-Id: e230a9d8be454e00a60613fc9409a9a4 Sep 02 05:17:00.711888 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Tenant-Name: admin Sep 02 05:17:00.711888 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-User: admin Sep 02 05:17:00.711888 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-User-Domain-Id: default Sep 02 05:17:00.711888 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-User-Domain-Name: Default Sep 02 05:17:00.711888 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-User-Id: f34e91012b144a309a3b1548fa885905 Sep 02 05:17:00.711888 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-User-Name: admin Sep 02 05:17:00.711888 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: method: > Sep 02 05:17:00.711888 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: exception: Flavor 42 could not be found. Sep 02 05:17:00.711888 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: action_args: {'id': '42'} Sep 02 05:17:00.711888 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:17:00.711888 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:17:00.712804 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 02 05:17:00.712804 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 02 05:17:00.712804 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 02 05:17:00.712804 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 02 05:17:00.712804 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 05:17:00.712804 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 05:17:00.712804 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 02 05:17:00.712804 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 02 05:17:00.712804 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 02 05:17:00.712804 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:17:00.712804 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 02 05:17:00.712804 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 02 05:17:00.712804 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 02 05:17:00.712804 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Sep 02 05:17:00.712804 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:17:00.712804 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Sep 02 05:17:00.712804 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:17:00.712804 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:17:00.712804 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:17:00.713970 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:17:00.713970 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:17:00.713970 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:17:00.713970 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:17:00.713970 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 02 05:17:00.713970 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:17:00.713970 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 02 05:17:00.713970 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Sep 02 05:17:00.713970 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:17:00.713970 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Sep 02 05:17:00.713970 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:17:00.713970 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:17:00.713970 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:17:00.713970 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:17:00.713970 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:17:00.713970 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 02 05:17:00.713970 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Sep 02 05:17:00.713970 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-855fd3b7-e55b-4b59-aee7-508cbcd5c707 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:17:00.715011 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-855fd3b7-e55b-4b59-aee7-508cbcd5c707 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015042 Sep 02 05:17:00.715011 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 22/42] 10.222.0.30 () {60 vars in 1190 bytes} [Fri Sep 2 05:17:00 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 05:17:01.682734 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-240def0e-e39b-4530-91c6-06e76a0395ca admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:17:01.683727 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-240def0e-e39b-4530-91c6-06e76a0395ca admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Sep 02 05:17:01.684132 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 21/43] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Sep 2 05:17:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:17:02.242708 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-520ba7e8-f452-4376-86f5-3322625a4097 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:17:02.248870 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.wsgi [None req-520ba7e8-f452-4376-86f5-3322625a4097 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 02 05:17:02.250377 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-520ba7e8-f452-4376-86f5-3322625a4097 admin admin] Request method failure captured: Sep 02 05:17:02.250377 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 02 05:17:02.250377 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: Accept: application/json Sep 02 05:17:02.250377 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: Accept-Encoding: gzip, deflate Sep 02 05:17:02.250377 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: Connection: keep-alive Sep 02 05:17:02.250377 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: Content-Length: 0 Sep 02 05:17:02.250377 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: Host: 10.222.0.30 Sep 02 05:17:02.250377 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: Openstack-Api-Version: compute 2.92 Sep 02 05:17:02.250377 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: Openstack-System-Scope: None Sep 02 05:17:02.250377 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: User-Agent: python-novaclient Sep 02 05:17:02.250377 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Auth-Token: gAAAAABjEZHNeG7Ykn6-AtAZcWWRq7EuqJgbBjpNq6M7LFOAhiIhDYJ8_Pu9cCqL0LG64uALxO3KT7cVPD96FaTs-TOt7DpivTq_Mh2Ba7uUin-v_kDwidPjdbBarrV6g7DRujvF5TfB2lxx6R89HTwrY-Mn3e8CjEhgCUOBM6EzMROiT2ifpB8 Sep 02 05:17:02.250377 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Domain-Id: None Sep 02 05:17:02.250377 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Domain-Name: None Sep 02 05:17:02.250377 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Identity-Status: Confirmed Sep 02 05:17:02.250377 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Is-Admin-Project: True Sep 02 05:17:02.250377 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Openstack-Nova-Api-Version: 2.92 Sep 02 05:17:02.250377 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Project-Domain-Id: default Sep 02 05:17:02.250377 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Project-Domain-Name: Default Sep 02 05:17:02.250377 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Project-Id: e230a9d8be454e00a60613fc9409a9a4 Sep 02 05:17:02.250377 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Project-Name: admin Sep 02 05:17:02.250377 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Role: member,admin,reader Sep 02 05:17:02.250377 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Roles: member,admin,reader Sep 02 05:17:02.252140 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e230a9d8be454e00a60613fc9409a9a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e230a9d8be454e00a60613fc9409a9a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e230a9d8be454e00a60613fc9409a9a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e230a9d8be454e00a60613fc9409a9a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:17:02.252140 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Tenant: admin Sep 02 05:17:02.252140 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Tenant-Id: e230a9d8be454e00a60613fc9409a9a4 Sep 02 05:17:02.252140 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Tenant-Name: admin Sep 02 05:17:02.252140 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-User: admin Sep 02 05:17:02.252140 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-User-Domain-Id: default Sep 02 05:17:02.252140 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-User-Domain-Name: Default Sep 02 05:17:02.252140 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-User-Id: f34e91012b144a309a3b1548fa885905 Sep 02 05:17:02.252140 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-User-Name: admin Sep 02 05:17:02.252140 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: method: > Sep 02 05:17:02.252140 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: exception: Flavor 84 could not be found. Sep 02 05:17:02.252140 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: action_args: {'id': '84'} Sep 02 05:17:02.252140 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:17:02.252140 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:17:02.253195 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 02 05:17:02.253195 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 02 05:17:02.253195 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 02 05:17:02.253195 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 02 05:17:02.253195 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 05:17:02.253195 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 05:17:02.253195 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 02 05:17:02.253195 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 02 05:17:02.253195 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 02 05:17:02.253195 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:17:02.253195 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 02 05:17:02.253195 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 02 05:17:02.253195 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 02 05:17:02.253195 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Sep 02 05:17:02.253195 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:17:02.253195 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Sep 02 05:17:02.253195 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:17:02.253195 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:17:02.253195 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:17:02.254652 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:17:02.254652 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:17:02.254652 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:17:02.254652 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:17:02.254652 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 02 05:17:02.254652 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:17:02.254652 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 02 05:17:02.254652 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Sep 02 05:17:02.254652 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:17:02.254652 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Sep 02 05:17:02.254652 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:17:02.254652 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:17:02.254652 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:17:02.254652 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:17:02.254652 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:17:02.254652 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 02 05:17:02.254652 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Sep 02 05:17:02.254652 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-520ba7e8-f452-4376-86f5-3322625a4097 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:17:02.256041 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-520ba7e8-f452-4376-86f5-3322625a4097 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.432683 Sep 02 05:17:02.256041 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 23/44] 10.222.0.30 () {60 vars in 1190 bytes} [Fri Sep 2 05:17:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 434 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 05:17:02.264284 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-7833edac-d225-4e1d-a353-c4e8747ab245 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:17:02.283700 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-7833edac-d225-4e1d-a353-c4e8747ab245 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.024928 Sep 02 05:17:02.284317 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1210 bytes} [Fri Sep 2 05:17:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:17:02.293912 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-2cf208bf-ee20-4f42-bcd0-1445e13e1515 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:17:02.309055 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-2cf208bf-ee20-4f42-bcd0-1445e13e1515 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018641 Sep 02 05:17:02.309540 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 24/46] 10.222.0.30 () {60 vars in 1210 bytes} [Fri Sep 2 05:17:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:17:02.318886 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-201f4ba8-5915-441d-9da8-cefabedc26be admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:17:02.324614 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.wsgi [None req-201f4ba8-5915-441d-9da8-cefabedc26be admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 02 05:17:02.326113 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-201f4ba8-5915-441d-9da8-cefabedc26be admin admin] Request method failure captured: Sep 02 05:17:02.326113 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 02 05:17:02.326113 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: Accept: application/json Sep 02 05:17:02.326113 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: Accept-Encoding: gzip, deflate Sep 02 05:17:02.326113 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: Connection: keep-alive Sep 02 05:17:02.326113 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: Content-Length: 0 Sep 02 05:17:02.326113 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: Host: 10.222.0.30 Sep 02 05:17:02.326113 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: Openstack-Api-Version: compute 2.92 Sep 02 05:17:02.326113 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: Openstack-System-Scope: None Sep 02 05:17:02.326113 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: User-Agent: python-novaclient Sep 02 05:17:02.326113 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Auth-Token: gAAAAABjEZHNeG7Ykn6-AtAZcWWRq7EuqJgbBjpNq6M7LFOAhiIhDYJ8_Pu9cCqL0LG64uALxO3KT7cVPD96FaTs-TOt7DpivTq_Mh2Ba7uUin-v_kDwidPjdbBarrV6g7DRujvF5TfB2lxx6R89HTwrY-Mn3e8CjEhgCUOBM6EzMROiT2ifpB8 Sep 02 05:17:02.326113 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Domain-Id: None Sep 02 05:17:02.326113 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Domain-Name: None Sep 02 05:17:02.326113 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Identity-Status: Confirmed Sep 02 05:17:02.326113 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Is-Admin-Project: True Sep 02 05:17:02.326113 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Openstack-Nova-Api-Version: 2.92 Sep 02 05:17:02.326113 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Project-Domain-Id: default Sep 02 05:17:02.326113 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Project-Domain-Name: Default Sep 02 05:17:02.326113 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Project-Id: e230a9d8be454e00a60613fc9409a9a4 Sep 02 05:17:02.326113 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Project-Name: admin Sep 02 05:17:02.326113 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Role: member,admin,reader Sep 02 05:17:02.326113 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Roles: member,admin,reader Sep 02 05:17:02.327803 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e230a9d8be454e00a60613fc9409a9a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e230a9d8be454e00a60613fc9409a9a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e230a9d8be454e00a60613fc9409a9a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e230a9d8be454e00a60613fc9409a9a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:17:02.327803 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Tenant: admin Sep 02 05:17:02.327803 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Tenant-Id: e230a9d8be454e00a60613fc9409a9a4 Sep 02 05:17:02.327803 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Tenant-Name: admin Sep 02 05:17:02.327803 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-User: admin Sep 02 05:17:02.327803 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-User-Domain-Id: default Sep 02 05:17:02.327803 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-User-Domain-Name: Default Sep 02 05:17:02.327803 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-User-Id: f34e91012b144a309a3b1548fa885905 Sep 02 05:17:02.327803 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-User-Name: admin Sep 02 05:17:02.327803 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: method: > Sep 02 05:17:02.327803 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: exception: Flavor 84 could not be found. Sep 02 05:17:02.327803 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: action_args: {'id': '84'} Sep 02 05:17:02.327803 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:17:02.327803 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:17:02.328896 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 02 05:17:02.328896 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 02 05:17:02.328896 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 02 05:17:02.328896 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 02 05:17:02.328896 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 05:17:02.328896 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 05:17:02.328896 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 02 05:17:02.328896 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 02 05:17:02.328896 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 02 05:17:02.328896 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:17:02.328896 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 02 05:17:02.328896 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 02 05:17:02.328896 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 02 05:17:02.328896 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Sep 02 05:17:02.328896 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:17:02.328896 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Sep 02 05:17:02.328896 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:17:02.328896 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:17:02.328896 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:17:02.330293 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:17:02.330293 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:17:02.330293 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:17:02.330293 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:17:02.330293 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 02 05:17:02.330293 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:17:02.330293 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 02 05:17:02.330293 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Sep 02 05:17:02.330293 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:17:02.330293 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Sep 02 05:17:02.330293 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:17:02.330293 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:17:02.330293 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:17:02.330293 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:17:02.330293 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:17:02.330293 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 02 05:17:02.330293 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Sep 02 05:17:02.330293 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-201f4ba8-5915-441d-9da8-cefabedc26be admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:17:02.331520 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-201f4ba8-5915-441d-9da8-cefabedc26be admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012132 Sep 02 05:17:02.331520 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 23/47] 10.222.0.30 () {60 vars in 1190 bytes} [Fri Sep 2 05:17:02 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 05:17:03.318998 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-2cf208bf-ee20-4f42-bcd0-1445e13e1515 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:17:03.319996 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-2cf208bf-ee20-4f42-bcd0-1445e13e1515 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Sep 02 05:17:03.320405 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 25/48] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Sep 2 05:17:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:17:03.891986 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-20396861-fc7e-4853-adc2-ed9efe6ab6eb admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:17:03.897895 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.wsgi [None req-20396861-fc7e-4853-adc2-ed9efe6ab6eb admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 02 05:17:03.899399 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-20396861-fc7e-4853-adc2-ed9efe6ab6eb admin admin] Request method failure captured: Sep 02 05:17:03.899399 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 02 05:17:03.899399 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: Accept: application/json Sep 02 05:17:03.899399 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: Accept-Encoding: gzip, deflate Sep 02 05:17:03.899399 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: Connection: keep-alive Sep 02 05:17:03.899399 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: Content-Length: 0 Sep 02 05:17:03.899399 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: Host: 10.222.0.30 Sep 02 05:17:03.899399 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: Openstack-Api-Version: compute 2.92 Sep 02 05:17:03.899399 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: Openstack-System-Scope: None Sep 02 05:17:03.899399 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: User-Agent: python-novaclient Sep 02 05:17:03.899399 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Auth-Token: gAAAAABjEZHPu8z8sXDlda6HvDc3AGykBRFBHWyj9BIGTJ9xcmrYiS7QRs1UCzQXqMZXqcLYE_OSVSp3hB-RS0HV2QqA8ziiNlQupp9p58pFhbzouDQLYbiKaKr5Dr1p1noQ73A0PaQds4M8SYRCcVqAn3samnvrG2kO4Jr1Nb0XkfgUdBUiFhQ Sep 02 05:17:03.899399 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Domain-Id: None Sep 02 05:17:03.899399 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Domain-Name: None Sep 02 05:17:03.899399 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Identity-Status: Confirmed Sep 02 05:17:03.899399 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Is-Admin-Project: True Sep 02 05:17:03.899399 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Openstack-Nova-Api-Version: 2.92 Sep 02 05:17:03.899399 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Project-Domain-Id: default Sep 02 05:17:03.899399 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Project-Domain-Name: Default Sep 02 05:17:03.899399 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Project-Id: e230a9d8be454e00a60613fc9409a9a4 Sep 02 05:17:03.899399 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Project-Name: admin Sep 02 05:17:03.899399 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Role: member,admin,reader Sep 02 05:17:03.899399 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Roles: member,admin,reader Sep 02 05:17:03.900827 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e230a9d8be454e00a60613fc9409a9a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e230a9d8be454e00a60613fc9409a9a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e230a9d8be454e00a60613fc9409a9a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e230a9d8be454e00a60613fc9409a9a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:17:03.900827 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Tenant: admin Sep 02 05:17:03.900827 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Tenant-Id: e230a9d8be454e00a60613fc9409a9a4 Sep 02 05:17:03.900827 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-Tenant-Name: admin Sep 02 05:17:03.900827 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-User: admin Sep 02 05:17:03.900827 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-User-Domain-Id: default Sep 02 05:17:03.900827 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-User-Domain-Name: Default Sep 02 05:17:03.900827 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-User-Id: f34e91012b144a309a3b1548fa885905 Sep 02 05:17:03.900827 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: X-User-Name: admin Sep 02 05:17:03.900827 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: method: > Sep 02 05:17:03.900827 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: exception: Flavor 451 could not be found. Sep 02 05:17:03.900827 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: action_args: {'id': '451'} Sep 02 05:17:03.900827 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:17:03.900827 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:17:03.901777 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 02 05:17:03.901777 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 02 05:17:03.901777 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 02 05:17:03.901777 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 02 05:17:03.901777 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 05:17:03.901777 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 05:17:03.901777 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 02 05:17:03.901777 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 02 05:17:03.901777 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 02 05:17:03.901777 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:17:03.901777 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 02 05:17:03.901777 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 02 05:17:03.901777 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 02 05:17:03.901777 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Sep 02 05:17:03.901777 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:17:03.901777 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Sep 02 05:17:03.901777 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:17:03.901777 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:17:03.901777 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:17:03.902844 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:17:03.902844 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:17:03.902844 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:17:03.902844 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:17:03.902844 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 02 05:17:03.902844 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:17:03.902844 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 02 05:17:03.902844 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Sep 02 05:17:03.902844 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:17:03.902844 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Sep 02 05:17:03.902844 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:17:03.902844 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:17:03.902844 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:17:03.902844 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:17:03.902844 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:17:03.902844 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 02 05:17:03.902844 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Sep 02 05:17:03.902844 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-20396861-fc7e-4853-adc2-ed9efe6ab6eb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:17:03.903955 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-20396861-fc7e-4853-adc2-ed9efe6ab6eb admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.446321 Sep 02 05:17:03.903955 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 24/49] 10.222.0.30 () {60 vars in 1193 bytes} [Fri Sep 2 05:17:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 447 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 05:17:03.911688 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-731e07b2-63e7-46b7-b7c8-3d90b85b043b admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:17:03.926992 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-731e07b2-63e7-46b7-b7c8-3d90b85b043b admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018827 Sep 02 05:17:03.927525 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 26/50] 10.222.0.30 () {60 vars in 1210 bytes} [Fri Sep 2 05:17:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:17:03.939412 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-8bf753bb-2a77-4842-9257-f9155049a4b5 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:17:03.954557 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-8bf753bb-2a77-4842-9257-f9155049a4b5 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018809 Sep 02 05:17:03.955069 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 25/51] 10.222.0.30 () {60 vars in 1210 bytes} [Fri Sep 2 05:17:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:17:03.964417 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-f4859589-bcde-41ab-bc55-013815fe9d23 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:17:03.970059 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.wsgi [None req-f4859589-bcde-41ab-bc55-013815fe9d23 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 02 05:17:03.971553 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-f4859589-bcde-41ab-bc55-013815fe9d23 admin admin] Request method failure captured: Sep 02 05:17:03.971553 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 02 05:17:03.971553 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: Accept: application/json Sep 02 05:17:03.971553 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: Accept-Encoding: gzip, deflate Sep 02 05:17:03.971553 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: Connection: keep-alive Sep 02 05:17:03.971553 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: Content-Length: 0 Sep 02 05:17:03.971553 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: Host: 10.222.0.30 Sep 02 05:17:03.971553 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: Openstack-Api-Version: compute 2.92 Sep 02 05:17:03.971553 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: Openstack-System-Scope: None Sep 02 05:17:03.971553 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: User-Agent: python-novaclient Sep 02 05:17:03.971553 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Auth-Token: gAAAAABjEZHPu8z8sXDlda6HvDc3AGykBRFBHWyj9BIGTJ9xcmrYiS7QRs1UCzQXqMZXqcLYE_OSVSp3hB-RS0HV2QqA8ziiNlQupp9p58pFhbzouDQLYbiKaKr5Dr1p1noQ73A0PaQds4M8SYRCcVqAn3samnvrG2kO4Jr1Nb0XkfgUdBUiFhQ Sep 02 05:17:03.971553 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Domain-Id: None Sep 02 05:17:03.971553 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Domain-Name: None Sep 02 05:17:03.971553 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Identity-Status: Confirmed Sep 02 05:17:03.971553 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Is-Admin-Project: True Sep 02 05:17:03.971553 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Openstack-Nova-Api-Version: 2.92 Sep 02 05:17:03.971553 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Project-Domain-Id: default Sep 02 05:17:03.971553 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Project-Domain-Name: Default Sep 02 05:17:03.971553 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Project-Id: e230a9d8be454e00a60613fc9409a9a4 Sep 02 05:17:03.971553 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Project-Name: admin Sep 02 05:17:03.971553 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Role: member,admin,reader Sep 02 05:17:03.971553 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Roles: member,admin,reader Sep 02 05:17:03.973173 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e230a9d8be454e00a60613fc9409a9a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e230a9d8be454e00a60613fc9409a9a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e230a9d8be454e00a60613fc9409a9a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e230a9d8be454e00a60613fc9409a9a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:17:03.973173 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Tenant: admin Sep 02 05:17:03.973173 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Tenant-Id: e230a9d8be454e00a60613fc9409a9a4 Sep 02 05:17:03.973173 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-Tenant-Name: admin Sep 02 05:17:03.973173 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-User: admin Sep 02 05:17:03.973173 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-User-Domain-Id: default Sep 02 05:17:03.973173 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-User-Domain-Name: Default Sep 02 05:17:03.973173 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-User-Id: f34e91012b144a309a3b1548fa885905 Sep 02 05:17:03.973173 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: X-User-Name: admin Sep 02 05:17:03.973173 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: method: > Sep 02 05:17:03.973173 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: exception: Flavor 451 could not be found. Sep 02 05:17:03.973173 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: action_args: {'id': '451'} Sep 02 05:17:03.973173 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:17:03.973173 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:17:03.974088 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 02 05:17:03.974088 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 02 05:17:03.974088 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 02 05:17:03.974088 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 02 05:17:03.974088 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 05:17:03.974088 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 05:17:03.974088 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 02 05:17:03.974088 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 02 05:17:03.974088 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 02 05:17:03.974088 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:17:03.974088 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 02 05:17:03.974088 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 02 05:17:03.974088 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 02 05:17:03.974088 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Sep 02 05:17:03.974088 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:17:03.974088 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Sep 02 05:17:03.974088 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:17:03.974088 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:17:03.974088 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:17:03.975191 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:17:03.975191 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:17:03.975191 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:17:03.975191 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:17:03.975191 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 02 05:17:03.975191 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:17:03.975191 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 02 05:17:03.975191 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Sep 02 05:17:03.975191 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:17:03.975191 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Sep 02 05:17:03.975191 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:17:03.975191 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:17:03.975191 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:17:03.975191 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:17:03.975191 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:17:03.975191 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 02 05:17:03.975191 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Sep 02 05:17:03.975191 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-f4859589-bcde-41ab-bc55-013815fe9d23 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:17:03.976285 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-f4859589-bcde-41ab-bc55-013815fe9d23 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012073 Sep 02 05:17:03.976285 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 27/52] 10.222.0.30 () {60 vars in 1193 bytes} [Fri Sep 2 05:17:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 05:17:04.950445 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-8bf753bb-2a77-4842-9257-f9155049a4b5 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:17:04.951383 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-8bf753bb-2a77-4842-9257-f9155049a4b5 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 02 05:17:04.951747 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 26/53] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Sep 2 05:17:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:17:05.508236 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-970f9d32-fe84-4af0-8bb7-d54bf9a5ed7d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:17:05.529485 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-970f9d32-fe84-4af0-8bb7-d54bf9a5ed7d admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.442539 Sep 02 05:17:05.529956 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 28/54] 10.222.0.30 () {64 vars in 1235 bytes} [Fri Sep 2 05:17:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 05:17:06.503539 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-8bf753bb-2a77-4842-9257-f9155049a4b5 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:17:06.504720 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-8bf753bb-2a77-4842-9257-f9155049a4b5 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002012 Sep 02 05:17:06.505117 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 27/55] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Sep 2 05:17:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:17:07.061125 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-278afe01-0821-456c-9c22-da4c7a3353ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:17:07.086503 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-278afe01-0821-456c-9c22-da4c7a3353ad admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.443149 Sep 02 05:17:07.087056 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 29/56] 10.222.0.30 () {64 vars in 1235 bytes} [Fri Sep 2 05:17:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 05:17:08.069791 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-8bf753bb-2a77-4842-9257-f9155049a4b5 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:17:08.070787 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-8bf753bb-2a77-4842-9257-f9155049a4b5 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Sep 02 05:17:08.071177 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 28/57] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Sep 2 05:17:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:17:08.627439 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-c0507873-e177-4844-8ca8-07b472aad381 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:17:08.651476 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-c0507873-e177-4844-8ca8-07b472aad381 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.444174 Sep 02 05:17:08.652022 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 30/58] 10.222.0.30 () {64 vars in 1235 bytes} [Fri Sep 2 05:17:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 05:17:09.642412 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-8bf753bb-2a77-4842-9257-f9155049a4b5 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:17:09.643424 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-8bf753bb-2a77-4842-9257-f9155049a4b5 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 02 05:17:09.643808 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 29/59] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Sep 2 05:17:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:17:10.204082 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-e2b0d44f-c27e-4bd8-9692-1081885019ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:17:10.226019 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-e2b0d44f-c27e-4bd8-9692-1081885019ff admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.445845 Sep 02 05:17:10.226585 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 31/60] 10.222.0.30 () {64 vars in 1235 bytes} [Fri Sep 2 05:17:09 2022] POST /compute/v2.1/flavors => generated 409 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 05:17:11.217659 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-8bf753bb-2a77-4842-9257-f9155049a4b5 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:17:11.218967 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-8bf753bb-2a77-4842-9257-f9155049a4b5 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001967 Sep 02 05:17:11.219530 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 30/61] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Sep 2 05:17:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:17:11.776807 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-14fac66a-896a-4d8a-8611-8cff7d4185a6 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:17:11.797493 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-14fac66a-896a-4d8a-8611-8cff7d4185a6 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.433674 Sep 02 05:17:11.798020 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 32/62] 10.222.0.30 () {60 vars in 1202 bytes} [Fri Sep 2 05:17:11 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:18:05.288022 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-8bf753bb-2a77-4842-9257-f9155049a4b5 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:18:05.289187 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-8bf753bb-2a77-4842-9257-f9155049a4b5 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001958 Sep 02 05:18:05.289589 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 31/63] 10.222.0.30 () {54 vars in 931 bytes} [Fri Sep 2 05:18:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:18:05.305889 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:18:05.708783 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-5ff984f8-bba7-4540-b0cc-15da8f506e6a admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:18:05.729740 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-5ff984f8-bba7-4540-b0cc-15da8f506e6a admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.430971 Sep 02 05:18:05.730286 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 33/64] 10.222.0.30 () {60 vars in 1292 bytes} [Fri Sep 2 05:18:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:18:05.751553 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:18:05.755794 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-4e2067f1-fde8-44b2-a504-022c8bfc4137 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:18:05.764446 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-4e2067f1-fde8-44b2-a504-022c8bfc4137 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014280 Sep 02 05:18:05.764975 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 32/65] 10.222.0.30 () {60 vars in 1283 bytes} [Fri Sep 2 05:18:05 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:18:05.779085 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-97685a6e-a52a-4a16-ae03-c7b9f19afead admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:18:05.790463 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-97685a6e-a52a-4a16-ae03-c7b9f19afead admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016899 Sep 02 05:18:05.791089 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 34/66] 10.222.0.30 () {60 vars in 1286 bytes} [Fri Sep 2 05:18:05 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:18:05.803115 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-e11511d7-a9db-4b60-82b3-096307c2e191 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:18:05.810954 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-e11511d7-a9db-4b60-82b3-096307c2e191 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011794 Sep 02 05:18:05.811464 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 33/67] 10.222.0.30 () {60 vars in 1286 bytes} [Fri Sep 2 05:18:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:18:05.823178 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-e49e2925-e3e3-4e7b-b01c-0e72e4a687c2 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:18:05.831109 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-e49e2925-e3e3-4e7b-b01c-0e72e4a687c2 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011577 Sep 02 05:18:05.831615 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 35/68] 10.222.0.30 () {60 vars in 1283 bytes} [Fri Sep 2 05:18:05 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:21:07.030624 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-e11511d7-a9db-4b60-82b3-096307c2e191 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:21:07.032172 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-e11511d7-a9db-4b60-82b3-096307c2e191 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002249 Sep 02 05:21:07.032770 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 34/69] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Sep 2 05:21:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:21:07.178051 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writing DB stats nova_api:SELECT=6 {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:21:07.357012 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-45930f04-4fdc-4bf6-be64-6793fbfea61f admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:21:07.363119 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-45930f04-4fdc-4bf6-be64-6793fbfea61f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:21:07.363891 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-45930f04-4fdc-4bf6-be64-6793fbfea61f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:21:07.364541 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-45930f04-4fdc-4bf6-be64-6793fbfea61f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:21:07.365685 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-45930f04-4fdc-4bf6-be64-6793fbfea61f admin admin] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:21:07.366402 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-45930f04-4fdc-4bf6-be64-6793fbfea61f admin admin] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:21:07.367070 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-45930f04-4fdc-4bf6-be64-6793fbfea61f admin admin] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:21:07.405876 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-45930f04-4fdc-4bf6-be64-6793fbfea61f admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.229284 Sep 02 05:21:07.406426 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 36/70] 10.222.0.30 () {60 vars in 1193 bytes} [Fri Sep 2 05:21:07 2022] GET /compute/v2.1/os-services => generated 791 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 05:21:08.230508 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-e11511d7-a9db-4b60-82b3-096307c2e191 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:21:08.231656 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-e11511d7-a9db-4b60-82b3-096307c2e191 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001735 Sep 02 05:21:08.232051 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 35/71] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Sep 2 05:21:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 05:21:08.438075 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-e036bd1e-c73e-45b3-94fe-68905eceb277 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:21:08.443142 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-e036bd1e-c73e-45b3-94fe-68905eceb277 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:21:08.443770 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-e036bd1e-c73e-45b3-94fe-68905eceb277 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:21:08.444451 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-e036bd1e-c73e-45b3-94fe-68905eceb277 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:21:08.445509 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-e036bd1e-c73e-45b3-94fe-68905eceb277 admin admin] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:21:08.446120 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-e036bd1e-c73e-45b3-94fe-68905eceb277 admin admin] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:21:08.446709 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-e036bd1e-c73e-45b3-94fe-68905eceb277 admin admin] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:21:08.469371 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-e036bd1e-c73e-45b3-94fe-68905eceb277 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.089521 Sep 02 05:21:08.469907 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 37/72] 10.222.0.30 () {60 vars in 1193 bytes} [Fri Sep 2 05:21:08 2022] GET /compute/v2.1/os-services => generated 791 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 05:21:19.734866 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-e11511d7-a9db-4b60-82b3-096307c2e191 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:21:19.735885 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-e11511d7-a9db-4b60-82b3-096307c2e191 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Sep 02 05:21:19.736301 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 36/73] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Sep 2 05:21:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:21:19.882585 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writing DB stats nova_cell0:SELECT=4 {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:21:19.883291 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writing DB stats nova_cell1:SELECT=4 {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:21:19.883943 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writing DB stats nova_api:SELECT=8 {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:21:19.937071 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-54974c1f-5678-4513-9ef4-13c60e4b2262 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:21:19.940466 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-54974c1f-5678-4513-9ef4-13c60e4b2262 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:21:19.940943 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-54974c1f-5678-4513-9ef4-13c60e4b2262 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:21:19.941371 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-54974c1f-5678-4513-9ef4-13c60e4b2262 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:21:19.942094 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-54974c1f-5678-4513-9ef4-13c60e4b2262 admin admin] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:21:19.942544 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-54974c1f-5678-4513-9ef4-13c60e4b2262 admin admin] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:21:19.942959 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-54974c1f-5678-4513-9ef4-13c60e4b2262 admin admin] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:21:19.968041 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-54974c1f-5678-4513-9ef4-13c60e4b2262 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.093529 Sep 02 05:21:19.968622 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 38/74] 10.222.0.30 () {60 vars in 1193 bytes} [Fri Sep 2 05:21:19 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:21:20.783522 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-e11511d7-a9db-4b60-82b3-096307c2e191 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:21:20.784568 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-e11511d7-a9db-4b60-82b3-096307c2e191 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 02 05:21:20.784962 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 37/75] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Sep 2 05:21:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:21:20.985635 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-e6a88ffc-4cb5-4586-aea0-29fa0b03b7d7 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:21:20.989096 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-e6a88ffc-4cb5-4586-aea0-29fa0b03b7d7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:21:20.989571 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-e6a88ffc-4cb5-4586-aea0-29fa0b03b7d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:21:20.989994 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-e6a88ffc-4cb5-4586-aea0-29fa0b03b7d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:21:20.990698 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-e6a88ffc-4cb5-4586-aea0-29fa0b03b7d7 admin admin] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:21:20.991150 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-e6a88ffc-4cb5-4586-aea0-29fa0b03b7d7 admin admin] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:21:20.991619 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-e6a88ffc-4cb5-4586-aea0-29fa0b03b7d7 admin admin] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:21:21.014301 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-e6a88ffc-4cb5-4586-aea0-29fa0b03b7d7 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.087842 Sep 02 05:21:21.014840 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 39/76] 10.222.0.30 () {60 vars in 1193 bytes} [Fri Sep 2 05:21:20 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:22:19.065420 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: Fri Sep 2 05:22:19 2022 - graceful shutdown triggered... Sep 02 05:22:19.066014 dv-cinder-853910-7-iscsi devstack@n-api.service[105461]: Gracefully killing worker 1 (pid: 105461)... Sep 02 05:22:19.066460 dv-cinder-853910-7-iscsi devstack@n-api.service[105462]: Gracefully killing worker 2 (pid: 105462)... Sep 02 05:22:19.066206 dv-cinder-853910-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 02 05:22:20.067124 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: worker 1 buried after 1 seconds Sep 02 05:22:20.067124 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: worker 2 buried after 1 seconds Sep 02 05:22:20.067124 dv-cinder-853910-7-iscsi devstack@n-api.service[105460]: goodbye to uWSGI. Sep 02 05:22:20.069562 dv-cinder-853910-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 02 05:22:20.070460 dv-cinder-853910-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 02 05:22:20.075074 dv-cinder-853910-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 02 05:22:20.093786 dv-cinder-853910-7-iscsi devstack@n-api.service[120436]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 02 05:22:20.095821 dv-cinder-853910-7-iscsi devstack@n-api.service[120436]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 2 05:22:20 2022] *** Sep 02 05:22:20.095821 dv-cinder-853910-7-iscsi devstack@n-api.service[120436]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 02 05:22:20.095821 dv-cinder-853910-7-iscsi devstack@n-api.service[120436]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 02 05:22:20.095821 dv-cinder-853910-7-iscsi devstack@n-api.service[120436]: nodename: dv-cinder-853910-7-iscsi Sep 02 05:22:20.095821 dv-cinder-853910-7-iscsi devstack@n-api.service[120436]: machine: x86_64 Sep 02 05:22:20.095821 dv-cinder-853910-7-iscsi devstack@n-api.service[120436]: clock source: unix Sep 02 05:22:20.095821 dv-cinder-853910-7-iscsi devstack@n-api.service[120436]: pcre jit disabled Sep 02 05:22:20.095821 dv-cinder-853910-7-iscsi devstack@n-api.service[120436]: detected number of CPU cores: 4 Sep 02 05:22:20.095821 dv-cinder-853910-7-iscsi devstack@n-api.service[120436]: current working directory: / Sep 02 05:22:20.095821 dv-cinder-853910-7-iscsi devstack@n-api.service[120436]: detected binary path: /usr/bin/uwsgi-core Sep 02 05:22:20.095821 dv-cinder-853910-7-iscsi devstack@n-api.service[120436]: your processes number limit is 47680 Sep 02 05:22:20.096742 dv-cinder-853910-7-iscsi devstack@n-api.service[120436]: your memory page size is 4096 bytes Sep 02 05:22:20.096742 dv-cinder-853910-7-iscsi devstack@n-api.service[120436]: detected max file descriptor number: 2048 Sep 02 05:22:20.096742 dv-cinder-853910-7-iscsi devstack@n-api.service[120436]: lock engine: pthread robust mutexes Sep 02 05:22:20.096742 dv-cinder-853910-7-iscsi devstack@n-api.service[120436]: thunder lock: enabled Sep 02 05:22:20.096742 dv-cinder-853910-7-iscsi devstack@n-api.service[120436]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 02 05:22:20.096742 dv-cinder-853910-7-iscsi devstack@n-api.service[120436]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 02 05:22:20.136084 dv-cinder-853910-7-iscsi devstack@n-api.service[120436]: Python main interpreter initialized at 0x557f80bc29c0 Sep 02 05:22:20.136084 dv-cinder-853910-7-iscsi devstack@n-api.service[120436]: python threads support enabled Sep 02 05:22:20.136084 dv-cinder-853910-7-iscsi devstack@n-api.service[120436]: your server socket listen backlog is limited to 100 connections Sep 02 05:22:20.136084 dv-cinder-853910-7-iscsi devstack@n-api.service[120436]: your mercy for graceful operations on workers is 90 seconds Sep 02 05:22:20.136583 dv-cinder-853910-7-iscsi devstack@n-api.service[120436]: mapped 403077 bytes (393 KB) for 2 cores Sep 02 05:22:20.136583 dv-cinder-853910-7-iscsi devstack@n-api.service[120436]: *** Operational MODE: preforking *** Sep 02 05:22:20.136810 dv-cinder-853910-7-iscsi devstack@n-api.service[120436]: *** uWSGI is running in multiple interpreter mode *** Sep 02 05:22:20.136810 dv-cinder-853910-7-iscsi devstack@n-api.service[120436]: spawned uWSGI master process (pid: 120436) Sep 02 05:22:20.137029 dv-cinder-853910-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 02 05:22:20.137585 dv-cinder-853910-7-iscsi devstack@n-api.service[120436]: spawned uWSGI worker 1 (pid: 120448, cores: 1) Sep 02 05:22:20.138089 dv-cinder-853910-7-iscsi devstack@n-api.service[120436]: spawned uWSGI worker 2 (pid: 120449, cores: 1) Sep 02 05:22:20.139285 dv-cinder-853910-7-iscsi devstack@n-api.service[120436]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 02 05:22:20.794964 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 02 05:22:20.798056 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 02 05:22:21.935508 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 05:22:21.935508 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: from cryptography.utils import int_from_bytes Sep 02 05:22:21.936332 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 05:22:21.936332 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: from cryptography.utils import int_from_bytes Sep 02 05:22:21.941112 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 05:22:21.941112 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: from cryptography.utils import int_from_bytes Sep 02 05:22:21.941624 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 05:22:21.941624 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: from cryptography.utils import int_from_bytes Sep 02 05:22:24.313754 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 05:22:24.314372 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 05:22:24.314658 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 05:22:24.314871 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 05:22:24.315126 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 05:22:24.315508 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.315836 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.316170 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.316515 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.316842 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.317119 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.317463 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.317777 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.318099 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.318358 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.318655 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.318949 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853910-7-iscsi {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.319443 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.319747 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.319888 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 05:22:24.320439 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.320538 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 05:22:24.320619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.320619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.320761 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 05:22:24.320954 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.321048 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 05:22:24.321251 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 05:22:24.321356 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.321673 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.321805 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.322054 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.322323 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.322644 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.323041 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.323279 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.323553 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.323778 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.324000 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.324290 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.324508 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.324723 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.324968 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.325206 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.325423 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.325629 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.325860 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.326065 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853910-7-iscsi {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.326274 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.326274 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.326689 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.327011 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.327255 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.327461 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.327714 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.327714 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.328171 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853910-7-iscsi {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.328420 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.328609 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.328804 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.328955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.329160 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.329310 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.329310 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.329592 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.329765 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.329947 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.330105 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.330257 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.330407 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.330561 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.330710 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.330854 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.331003 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.331146 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.331323 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.331479 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.331624 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.332952 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.333146 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.333306 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.333454 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.333615 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.333767 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.333986 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.334152 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.334152 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.334439 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853910-7-iscsi {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.334590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.334741 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.334892 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.335045 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.335206 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.335368 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.335511 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.335652 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.335801 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.335950 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.336094 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.336278 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.336423 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.336572 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.336715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.336715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.337032 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.337177 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.337331 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.337482 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.337634 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.337776 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.337935 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.338087 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.338230 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.338372 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.338566 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.338727 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.338881 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.339031 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.339181 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.339326 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.339480 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.339633 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.339776 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.339918 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.340059 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.340234 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.340378 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.340538 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.340682 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.340841 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.340984 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.341126 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.341270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.341434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.341578 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.341728 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.341889 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.342499 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.342662 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.342808 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.343150 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.343327 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.343478 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.343622 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.343776 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.343928 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.344081 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.344260 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.344414 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.344576 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.344727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.344871 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.345021 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.345178 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.345320 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.345472 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.345614 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.345756 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.345904 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.346057 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.346208 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.346365 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.346508 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.346656 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.346799 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.346959 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.347109 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.347267 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.347417 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.347568 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.347716 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.347868 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.348023 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.348194 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.348349 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.348502 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.348693 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.348849 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.349020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.349171 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.349317 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.349459 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.349459 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.349748 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.349901 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.350045 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.350197 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.350350 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.350499 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.350643 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.350867 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.351032 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.351176 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.351325 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.351467 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.351617 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.351760 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.351909 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.352057 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.352669 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.352831 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.352990 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.353314 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.353473 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.353627 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.353777 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.353930 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.354084 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.354234 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.354383 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.354542 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.354695 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.354986 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.355142 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.355285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.355435 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.355594 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.355748 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.355890 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.356031 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.356250 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.356432 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.356585 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.356737 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.356879 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.357030 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.357173 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.357324 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.357468 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.357619 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.357770 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.357923 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.358074 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.358711 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.358866 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.359018 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.359170 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.359313 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.359456 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.359618 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.359762 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.359905 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.360065 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.360256 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.360410 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.360569 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.361616 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.361769 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.361924 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.362075 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.362227 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.363030 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.363189 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.363612 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.363787 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.363932 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.364075 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.364257 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.364412 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.364556 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.364707 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.364858 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.365001 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.365156 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.365301 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.365451 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.365595 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.365749 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.365902 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.366053 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.366196 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.366346 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.366346 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.366637 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.366795 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.366939 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.367082 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.367082 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.367082 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.367481 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.367650 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.367802 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.367954 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.368103 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.368103 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.368475 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.368621 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.368819 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.368975 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.369126 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.369277 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.369434 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.369912 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.369912 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.370196 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.370346 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.370346 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.370677 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.370822 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.370972 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.370972 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.371261 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.371404 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:22:24.371560 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.371712 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.371880 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.372024 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.372194 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.372194 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.373416 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.373601 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.373601 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.374010 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.374173 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.375274 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.375437 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.375596 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.375742 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.375902 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.376053 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.376233 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.376388 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.376541 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.376684 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.376848 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.376994 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.377144 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.377296 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.377456 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.377608 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.377770 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.377921 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.378065 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.378222 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.378366 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.378514 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.378665 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.379016 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.379188 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.379349 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.379349 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.379630 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.379630 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.379630 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.379630 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.380275 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.380554 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.380710 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.380843 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.380843 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.381203 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.381349 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.381492 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.381638 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.381779 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.381927 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.382094 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.382231 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.382371 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.382516 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.382672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.383039 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.383496 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.383602 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.383690 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.383781 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.383888 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.383989 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.384070 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.384160 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.384248 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.384337 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.384429 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.384533 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.384618 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.384709 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.384800 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.384885 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.385110 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.385272 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.385502 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.385635 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.385753 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.385874 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.385994 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.386115 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.386225 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.386225 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.386439 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.386556 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.386676 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.386806 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.386806 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.387170 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.387309 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.387447 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.387591 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.387730 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.387856 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.387856 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.388073 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.388228 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.388362 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.388475 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.388592 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.388742 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.388877 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.389047 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.389192 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.389283 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.389496 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.389600 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.389695 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.389800 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.389800 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.389965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.390047 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.390197 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.390334 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.390471 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.390569 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.390654 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.390744 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.390837 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.390921 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.391017 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.391114 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.391214 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.391306 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.391306 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.391467 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.391561 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.391646 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.391736 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.391827 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.391911 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.392002 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.392086 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.392202 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.392289 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.392380 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.392464 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.392555 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.392647 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.392732 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.392816 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.392899 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.393049 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.393194 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.393348 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.393635 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.393730 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.393823 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.393916 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.394010 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.394095 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.394178 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.394262 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.394401 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.394546 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.394697 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.394834 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.394923 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.395051 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.395155 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.395255 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.395341 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.395431 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.395706 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.395800 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.395891 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.395985 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.395985 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.396281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.396382 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.396469 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.396561 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.396654 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.396739 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.396830 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.396914 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.397002 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.397102 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.397194 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.397277 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.397359 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.397448 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.397539 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.397701 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.397790 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.397881 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.397975 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.398067 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.398165 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.398262 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.398355 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.398447 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.398531 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.398644 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.398744 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.398952 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.399069 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.399262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.399356 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.399569 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.399668 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.399874 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.399966 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.400207 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.400318 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.400528 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.400630 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.400831 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.400923 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.401137 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.401235 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.401446 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.401672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.401794 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.402107 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.402456 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.402801 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.403127 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.403454 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.403751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.403883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.404011 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.404152 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.404282 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.404405 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.404523 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.404706 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.404831 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.405048 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.405254 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.406245 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.406364 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.406473 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.406582 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.406701 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.406827 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.406947 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.407067 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.407184 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.407296 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.407414 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.407550 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.407668 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.407786 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.407897 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.408025 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.408228 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.408363 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.408476 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.408606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.408606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.408819 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.408940 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.409062 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.409196 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.409332 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.409461 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.409551 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.409705 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.409835 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.410016 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.410107 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.410389 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.410496 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.410712 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.410893 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.411038 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.411239 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.411543 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.411686 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.411836 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.411933 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.412272 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.412388 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.412618 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.412787 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.412920 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.413109 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.413278 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.413465 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.413610 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.413845 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.413938 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.414070 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.414321 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.414432 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.414632 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.414894 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.415027 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.415203 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.415331 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.415526 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.415648 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.415848 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.415978 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.416336 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.416442 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.416541 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.416635 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.416852 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.416954 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.417173 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.417266 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.417480 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.417588 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.417783 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.417875 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.418101 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.418192 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.418408 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.418518 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.418711 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.418804 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.419015 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.419105 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.419317 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.419425 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.419633 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.419734 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.419948 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.420040 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.420274 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.420381 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.420605 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.420708 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.420972 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.421065 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.421284 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.421421 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.421602 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.421703 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.421908 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.422002 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.422217 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.422313 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.422537 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.422628 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.422848 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.422940 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.423154 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.423246 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.423463 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.423554 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.423772 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.423926 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.424076 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.424230 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.424408 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.424507 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.424730 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.424831 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.425037 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.425152 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.425350 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.425485 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.425661 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.425793 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.425960 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.426074 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.426267 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.426385 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.426581 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.426688 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.426894 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.427173 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.427277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.427507 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.427612 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.427823 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.427925 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.428158 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.428287 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.428468 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.428579 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.428790 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.428902 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.429106 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.429242 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.429423 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.429521 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.429740 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.429846 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.430046 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.430157 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.430356 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.430455 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.430662 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.430763 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.430970 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.431067 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.431277 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.431380 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.431571 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.431667 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.431873 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.432185 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.432395 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.432482 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.432567 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.432776 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.432883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.433082 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.433178 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.433382 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.433478 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.433723 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.433856 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.434084 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.434184 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.434386 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.434486 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.434694 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.434791 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.434999 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.435109 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.435328 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.435423 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.435625 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.435732 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.435926 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.436023 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.436289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.436483 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.436631 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.436731 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.436910 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.437005 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.437199 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.437349 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.437498 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.437646 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.437791 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.437945 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.438094 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.438257 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.438536 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.438852 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.439176 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.439486 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.439644 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.439813 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.440034 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.440215 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.440371 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.440559 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.440719 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.440885 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.441052 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.441265 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.441423 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.441575 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.441717 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.441866 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.442016 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.442170 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.442326 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.442479 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.442638 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.442788 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.442950 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.443093 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.443298 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.443444 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.443586 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.443759 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.443915 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.444072 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.444327 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.444327 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.444618 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.444770 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.444937 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.445108 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.445252 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.445392 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.445541 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.445690 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.445838 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.445995 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.446139 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.446290 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.446440 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.446583 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.446731 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.446881 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.447033 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.447183 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.447324 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.447472 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.447623 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.447773 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.447915 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.448064 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.448228 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.448381 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.448566 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.448712 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.448861 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.449017 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.449160 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.449309 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.449464 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.449639 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.449790 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.449940 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.450170 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.450319 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.450475 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.450625 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.450775 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.450934 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.451083 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.451255 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.451468 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.451614 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.451756 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.451973 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.452221 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.452422 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.452624 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.452808 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.453002 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.453194 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.453408 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.453620 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.453817 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.454001 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.454185 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.454396 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.454584 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.454783 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.454982 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.455169 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.455312 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.455452 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.455608 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.455769 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.455912 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.456061 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.456229 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.456371 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.456530 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.456714 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.456857 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.456998 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.457139 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.457280 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.457438 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.457587 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.457739 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.457888 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.458030 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.458178 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.458334 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.458483 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.458626 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.458775 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.458924 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.459080 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.459230 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.459379 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.459530 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.459679 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.459828 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.459979 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.460145 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.460304 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.460446 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.460620 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.460813 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.460968 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.461119 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.461261 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.461409 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.461646 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.461794 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.461945 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.462097 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.462248 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.462390 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.462540 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.462682 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.462837 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.462989 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.463131 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.463280 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.463432 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.463603 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.463746 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.463895 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.464037 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.464208 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.464357 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.464510 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.464707 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.464853 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.464995 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.465145 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.465294 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.465449 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.465600 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.465757 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.465907 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.466056 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.466198 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.466352 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.466506 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.466655 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.466804 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.466946 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.467101 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.467243 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.467392 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.467577 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.467728 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.467885 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.468040 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.468040 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.468347 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.468518 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.468679 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.468821 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.468990 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.469145 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.469287 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.469287 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.469584 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.469726 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.469881 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.470023 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.470163 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.470305 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.470454 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.470612 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.470771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.470934 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.471089 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.471246 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.471405 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.471561 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.471798 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.471962 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.472111 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.472321 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.472487 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.472756 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.472910 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.473067 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.473216 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.473371 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.473519 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.473694 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.473842 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.473996 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.474152 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.474307 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.474466 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.474648 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.474648 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.474946 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.475095 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.475271 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.475430 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.475580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.475753 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.475903 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.475903 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.476219 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.476219 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.476521 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.476668 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.476814 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.476961 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.477116 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.477277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.477426 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.477591 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.477747 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.477895 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.478051 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.478207 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.478355 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.478512 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.478661 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.478808 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.478969 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.479132 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.479280 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.479435 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.479593 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.479749 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.479906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.480056 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.480056 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.480384 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.480550 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.480708 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.480870 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.481025 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.481190 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.481374 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.481534 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.481705 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.481941 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.482105 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.482262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.482425 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.482586 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.482743 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.482900 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.483067 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.483287 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.483439 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.483601 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.483761 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.483911 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.484058 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.484263 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.484428 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.484586 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.484742 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.484892 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.485040 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.485197 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.485353 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.485509 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.485658 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.485817 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.486000 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.486161 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.486161 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.486460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.486618 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.486779 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.486928 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.487090 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.487247 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.487397 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.487545 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.487545 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.487844 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.488000 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.488225 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.488392 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.488551 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.488700 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.488895 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.489063 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.489213 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.489369 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.489524 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.489680 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.489845 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.490003 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.490159 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.490307 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.490456 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.490611 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.490767 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.490915 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.491070 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.491219 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.491374 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.491529 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.491685 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.491850 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.492085 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.492281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.492440 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.492590 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.492752 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.492900 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.493048 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.493204 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.493354 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.493516 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.493678 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.493835 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.494001 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.494157 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.494313 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.494538 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.495007 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.495157 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.495304 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.495460 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.495616 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.495777 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.495925 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.496073 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.496241 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.496404 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.496551 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.496711 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.496859 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.497007 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.497163 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.497326 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.497482 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.497639 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.497794 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.497950 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.498098 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.498264 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.498426 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.498575 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.498750 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.498910 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.499066 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.499223 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.499380 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.499536 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.499686 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.499833 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.499987 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.500191 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.500374 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.500531 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.500689 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.500844 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.501001 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.501148 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.501315 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.501315 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.501606 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.501754 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.501900 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.502077 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.502304 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.502474 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.502622 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.502778 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.502934 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.503092 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.503239 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.503395 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.503544 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.503701 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.503849 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.504005 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.504172 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.504337 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.504496 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.504643 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.504793 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.504980 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.505135 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.505283 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.505439 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.505588 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.505744 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.505900 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.506049 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.506195 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.506352 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.506507 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.506664 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.506819 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.506975 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.507138 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.507287 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.507435 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.507591 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.507739 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.507894 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.508051 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.508233 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.508402 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.508563 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.508720 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.508877 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.509027 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.509175 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.509336 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.509494 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.509642 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.509789 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.509937 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.510085 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.510085 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.510385 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.510541 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.510689 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.510837 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.510991 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.511148 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.511296 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.511444 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.511590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.511737 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.511891 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.512047 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.512230 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.512481 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.512636 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.512790 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.512952 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.513113 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.513269 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.513269 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.513569 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.513719 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.513875 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.514039 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.514202 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.514451 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.514607 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.514756 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.514914 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.515064 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.515281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.515455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.515607 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.515763 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.515913 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.516060 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.516266 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.516442 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.516595 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.516752 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.516909 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.517067 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.517216 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.517363 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.517521 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.517678 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.517827 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.517976 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.518123 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.518289 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.518449 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.518606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.519447 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.519610 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.519769 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.519928 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.520093 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.520265 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.520415 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.520581 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.520730 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.520899 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.520899 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.521227 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.521384 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.521534 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.521689 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.521848 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.521997 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.522143 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.522298 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.522480 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.522706 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.522885 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.523043 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.523199 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.523199 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.523483 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.523645 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.523796 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.523952 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.524102 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.524384 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.524534 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.524760 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.524921 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.525079 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.525234 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.525383 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.525532 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.525689 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.525846 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.525994 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.526141 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.526288 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.526445 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.526596 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.526743 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.526743 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.527038 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.527187 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.527346 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.527495 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.527642 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.527796 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.527946 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.528093 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.528292 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.528415 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.528515 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.528610 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.528696 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.528696 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.528877 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.528982 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.529110 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.529218 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.529313 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.529442 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.529527 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.529619 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.529704 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.529795 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.529881 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.530008 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.530138 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.530233 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.530319 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.530410 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.530501 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.530602 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.530695 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.530789 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.530881 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.530881 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.531046 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.531144 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.531230 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.531312 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.531396 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.531478 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.531571 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.531663 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.531747 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.531833 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.531916 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.531998 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.532096 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.532206 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.532291 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.532375 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.532458 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.532541 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.532541 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.532714 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.532793 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.532862 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.533007 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.533178 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.533345 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.533497 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.533654 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.533813 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.533962 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.534125 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.534287 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.534442 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.534601 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.534757 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.534913 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.535084 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.535235 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.535390 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.535538 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.535685 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.535850 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.536008 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.536195 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.536360 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.536360 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.536652 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.536799 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.536953 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.537144 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.537296 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.537445 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.537591 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.537761 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.537916 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.538068 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.538214 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.538363 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.538519 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.538682 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.538837 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.538993 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.539141 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.539315 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.539472 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.539659 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.539833 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.539992 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.540184 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.540353 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.540502 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.540664 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.540821 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.540969 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.541117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.541273 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.541430 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.541587 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.541734 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.541900 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.542049 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.542196 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.542352 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.542509 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.542659 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.542835 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.543055 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.543215 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.543373 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.543522 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.543671 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.543836 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.544005 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.544005 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.544356 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.544507 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.544656 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.544810 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.544987 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.545162 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.545162 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.545452 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.545767 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.545931 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.546098 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.546255 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.546412 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.546569 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.546717 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.546865 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.547012 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.547174 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.547321 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.547469 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.547617 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.547764 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.547931 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.548080 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.548345 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.548498 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.548647 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.548795 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.548958 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.549108 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.549256 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.549403 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.549551 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.549700 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.549860 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.550021 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.550176 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.550324 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.550487 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.550723 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.550874 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.551033 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.551183 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.551330 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.551486 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.551648 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.551805 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.551966 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.552176 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.552342 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.552492 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.552659 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.552816 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.552972 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.553218 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.553373 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.553536 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.553685 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.553840 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.553997 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.554165 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.554324 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.554481 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.554630 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.554777 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.554924 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.555079 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.555229 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.555385 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.555541 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.555697 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.555856 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.556017 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.556195 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.556357 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.556506 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.556655 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.556655 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.556943 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.557101 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.557259 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.557408 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.557555 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.557702 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.557859 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.558021 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.558170 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.558318 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.558465 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.558612 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.558768 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.558927 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.559077 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.559224 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.559373 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.559527 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.559684 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.559846 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.560001 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.560196 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.560351 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.560510 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.560510 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.560810 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.560969 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.561125 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.561331 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.561490 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.561651 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.561807 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.561965 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.562120 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.562268 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.562429 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.562578 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.562725 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.562873 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.563027 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.563200 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.563429 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.563584 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.563739 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.563942 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.564101 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.564282 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.564451 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.564602 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.564757 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.564912 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.565060 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.565206 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.565363 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.565519 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.565676 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.565832 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.565997 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.566159 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.566316 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.566472 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.566620 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.566767 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.566916 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.567072 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.567227 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.567383 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.567531 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.567678 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.567833 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.568005 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.568182 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.568353 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.568504 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.568651 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.568806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.568967 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.569116 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.569302 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.569459 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.569608 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.569770 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.569930 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.570084 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.570233 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.570381 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.570527 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.570683 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.570840 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.570990 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.571136 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.571283 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.571437 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.571594 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.571742 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.572517 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.572686 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.572844 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.573005 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.573166 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.573315 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.573560 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.573716 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.573872 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.574032 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.574191 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.574357 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.574517 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.574674 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.574824 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.574985 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.575143 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.575293 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.575449 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.575606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.575754 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.575917 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.576066 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.576280 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.576440 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.576598 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.576757 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.576943 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.577107 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.577258 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.577414 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.577564 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.577726 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.577882 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.578032 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.578188 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.578347 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.578506 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.578669 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.578818 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.578974 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.579122 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.579279 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.579443 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.579600 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.579750 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.579905 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.580054 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.580054 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 05:22:24.580448 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.580448 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.580448 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.580448 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.580448 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.580448 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.580448 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.580448 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.581592 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.581592 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.581592 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.582019 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.582019 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.582342 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.582671 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.582990 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.583307 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.583615 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:22:24.583860 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 05:22:24.638549 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO dbcounter [None req-19f798cb-74a8-4b47-a8f8-2e17590e853a None None] Registered counter for database nova_api Sep 02 05:22:24.644890 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO dbcounter [None req-8f714057-5703-4479-917f-2a7dec20962f None None] Registered counter for database nova_api Sep 02 05:22:24.659812 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_db.sqlalchemy.engines [None req-19f798cb-74a8-4b47-a8f8-2e17590e853a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120448) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 05:22:24.665468 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_db.sqlalchemy.engines [None req-8f714057-5703-4479-917f-2a7dec20962f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 05:22:24.667083 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writer thread running {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 05:22:24.672438 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writer thread running {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 05:22:24.722573 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.context [None req-19f798cb-74a8-4b47-a8f8-2e17590e853a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),90ca4909-2326-46fd-b0af-6442bf8c1fe3(cell1) {{(pid=120448) load_cells /opt/stack/nova/nova/context.py:464}} Sep 02 05:22:24.726629 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19f798cb-74a8-4b47-a8f8-2e17590e853a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:22:24.727104 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19f798cb-74a8-4b47-a8f8-2e17590e853a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:22:24.728220 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.context [None req-8f714057-5703-4479-917f-2a7dec20962f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),90ca4909-2326-46fd-b0af-6442bf8c1fe3(cell1) {{(pid=120449) load_cells /opt/stack/nova/nova/context.py:464}} Sep 02 05:22:24.728698 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19f798cb-74a8-4b47-a8f8-2e17590e853a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:22:24.729480 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19f798cb-74a8-4b47-a8f8-2e17590e853a None None] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:22:24.729855 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19f798cb-74a8-4b47-a8f8-2e17590e853a None None] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:22:24.731892 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19f798cb-74a8-4b47-a8f8-2e17590e853a None None] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:22:24.732236 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8f714057-5703-4479-917f-2a7dec20962f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:22:24.732750 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8f714057-5703-4479-917f-2a7dec20962f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:22:24.733992 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO dbcounter [None req-19f798cb-74a8-4b47-a8f8-2e17590e853a None None] Registered counter for database nova_cell0 Sep 02 05:22:24.734393 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8f714057-5703-4479-917f-2a7dec20962f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:22:24.735169 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8f714057-5703-4479-917f-2a7dec20962f None None] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:22:24.735569 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8f714057-5703-4479-917f-2a7dec20962f None None] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:22:24.738025 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO dbcounter [None req-19f798cb-74a8-4b47-a8f8-2e17590e853a None None] Registered counter for database nova_cell1 Sep 02 05:22:24.740711 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8f714057-5703-4479-917f-2a7dec20962f None None] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:22:24.742990 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO dbcounter [None req-8f714057-5703-4479-917f-2a7dec20962f None None] Registered counter for database nova_cell0 Sep 02 05:22:24.747637 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_db.sqlalchemy.engines [None req-19f798cb-74a8-4b47-a8f8-2e17590e853a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120448) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 05:22:24.748094 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO dbcounter [None req-8f714057-5703-4479-917f-2a7dec20962f None None] Registered counter for database nova_cell1 Sep 02 05:22:24.749497 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_db.sqlalchemy.engines [None req-19f798cb-74a8-4b47-a8f8-2e17590e853a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120448) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 05:22:24.753501 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writer thread running {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 05:22:24.757720 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_db.sqlalchemy.engines [None req-8f714057-5703-4479-917f-2a7dec20962f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 05:22:24.759446 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_db.sqlalchemy.engines [None req-8f714057-5703-4479-917f-2a7dec20962f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 05:22:24.765788 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writer thread running {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 05:22:24.767050 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writer thread running {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 05:22:24.891140 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writer thread running {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 05:22:24.900248 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO dbcounter [None req-19f798cb-74a8-4b47-a8f8-2e17590e853a None None] Registered counter for database nova_cell0 Sep 02 05:22:24.907130 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_db.sqlalchemy.engines [None req-19f798cb-74a8-4b47-a8f8-2e17590e853a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120448) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 05:22:24.910197 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO dbcounter [None req-8f714057-5703-4479-917f-2a7dec20962f None None] Registered counter for database nova_cell0 Sep 02 05:22:24.911984 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writer thread running {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 05:22:24.918933 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_db.sqlalchemy.engines [None req-8f714057-5703-4479-917f-2a7dec20962f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 05:22:24.923881 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writer thread running {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 05:22:25.222606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: WARNING keystonemiddleware.auth_token [None req-19f798cb-74a8-4b47-a8f8-2e17590e853a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 05:22:25.229810 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: WARNING keystonemiddleware.auth_token [None req-19f798cb-74a8-4b47-a8f8-2e17590e853a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 05:22:25.235544 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: WARNING keystonemiddleware.auth_token [None req-8f714057-5703-4479-917f-2a7dec20962f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 05:22:25.242836 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: WARNING keystonemiddleware.auth_token [None req-8f714057-5703-4479-917f-2a7dec20962f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 05:22:25.571753 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: WARNING keystonemiddleware.auth_token [None req-19f798cb-74a8-4b47-a8f8-2e17590e853a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 05:22:25.578360 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: WARNING keystonemiddleware.auth_token [None req-19f798cb-74a8-4b47-a8f8-2e17590e853a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 05:22:25.583793 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557f80bc29c0 pid: 120448 (default app) Sep 02 05:22:25.584815 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: WARNING keystonemiddleware.auth_token [None req-8f714057-5703-4479-917f-2a7dec20962f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 05:22:25.590805 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: WARNING keystonemiddleware.auth_token [None req-8f714057-5703-4479-917f-2a7dec20962f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 05:22:25.596205 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557f80bc29c0 pid: 120449 (default app) Sep 02 05:23:02.126929 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=3 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:02.126929 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=3 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:02.127583 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell0:SELECT=3 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:02.127919 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell0:SELECT=3 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:03.615880 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-dd9b825b-6604-4ddb-b342-3f1242ba7656 tempest-VolumesGetTestJSON-289301174 tempest-VolumesGetTestJSON-289301174-project] Action: 'create', calling method: .version_select at 0x7fc90c319700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1136767835", "metadata": {"Type": "work"}}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:23:04.883733 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-dd9b825b-6604-4ddb-b342-3f1242ba7656 tempest-VolumesGetTestJSON-289301174 tempest-VolumesGetTestJSON-289301174-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.770188 Sep 02 05:23:04.884758 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 1/1] 10.222.0.30 () {60 vars in 1156 bytes} [Fri Sep 2 05:23:02 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2774 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 02 05:23:05.275487 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ee75b726-e28d-407c-b43d-9573c31ca215 tempest-VolumesGetTestJSON-289301174 tempest-VolumesGetTestJSON-289301174-project] Calling method '.version_select at 0x7fc90c3c4280>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:05.307753 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_api:SELECT=3 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:05.308911 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell0:SELECT=3 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:05.309952 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=3 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:05.311083 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell0:SELECT=3 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:05.640423 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-ee75b726-e28d-407c-b43d-9573c31ca215 tempest-VolumesGetTestJSON-289301174 tempest-VolumesGetTestJSON-289301174-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/15b7dac1-5977-4921-97a2-2edfd7774b04" status: 200 len: 353 microversion: 2.1 time: 0.743417 Sep 02 05:23:05.643386 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 1/2] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Sep 2 05:23:04 2022] GET /compute/v2.1/os-volumes/15b7dac1-5977-4921-97a2-2edfd7774b04 => generated 353 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:23:06.181113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-588d5127-b1f5-4942-9466-b9e962c96217 tempest-VolumesTestJSON-1314767656 tempest-VolumesTestJSON-1314767656-project] Calling method '.version_select at 0x7fc90c1ed550>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:06.362564 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-588d5127-b1f5-4942-9466-b9e962c96217 tempest-VolumesTestJSON-1314767656 tempest-VolumesTestJSON-1314767656-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/345f57f0-af78-4f6f-8b19-ecf36dbaf4a5" status: 200 len: 351 microversion: 2.1 time: 0.189960 Sep 02 05:23:06.363513 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Sep 2 05:23:06 2022] GET /compute/v2.1/os-volumes/345f57f0-af78-4f6f-8b19-ecf36dbaf4a5 => generated 351 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 05:23:06.656677 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-51071511-eb02-4f78-8f16-294339d3b9e9 tempest-VolumesGetTestJSON-289301174 tempest-VolumesGetTestJSON-289301174-project] Calling method '.version_select at 0x7fc90c21f550>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:06.835207 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-51071511-eb02-4f78-8f16-294339d3b9e9 tempest-VolumesGetTestJSON-289301174 tempest-VolumesGetTestJSON-289301174-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/15b7dac1-5977-4921-97a2-2edfd7774b04" status: 200 len: 354 microversion: 2.1 time: 0.183490 Sep 02 05:23:06.836213 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 2/4] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Sep 2 05:23:06 2022] GET /compute/v2.1/os-volumes/15b7dac1-5977-4921-97a2-2edfd7774b04 => generated 354 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:23:06.848367 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-8a633fcc-2df6-4b55-9348-6d5a22ba2bf4 tempest-VolumesGetTestJSON-289301174 tempest-VolumesGetTestJSON-289301174-project] Calling method '.version_select at 0x7fc90c1edca0>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:07.145462 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-8a633fcc-2df6-4b55-9348-6d5a22ba2bf4 tempest-VolumesGetTestJSON-289301174 tempest-VolumesGetTestJSON-289301174-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/15b7dac1-5977-4921-97a2-2edfd7774b04" status: 200 len: 354 microversion: 2.1 time: 0.301203 Sep 02 05:23:07.146030 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 3/5] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Sep 2 05:23:06 2022] GET /compute/v2.1/os-volumes/15b7dac1-5977-4921-97a2-2edfd7774b04 => generated 354 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:23:07.165714 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-61620d8e-da3a-438e-93f7-54b67dd24fad tempest-VolumesGetTestJSON-289301174 tempest-VolumesGetTestJSON-289301174-project] Calling method '.version_select at 0x7fc90c21f700>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:07.350746 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-61620d8e-da3a-438e-93f7-54b67dd24fad tempest-VolumesGetTestJSON-289301174 tempest-VolumesGetTestJSON-289301174-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/15b7dac1-5977-4921-97a2-2edfd7774b04" status: 202 len: 0 microversion: 2.1 time: 0.189076 Sep 02 05:23:07.351309 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 3/6] 10.222.0.30 () {58 vars in 1248 bytes} [Fri Sep 2 05:23:07 2022] DELETE /compute/v2.1/os-volumes/15b7dac1-5977-4921-97a2-2edfd7774b04 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:23:07.359394 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-0c1311a5-bdf9-41fc-92c1-50af246c87e4 tempest-VolumesGetTestJSON-289301174 tempest-VolumesGetTestJSON-289301174-project] Calling method '.version_select at 0x7fc90c1843a0>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:07.456738 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-0c1311a5-bdf9-41fc-92c1-50af246c87e4 tempest-VolumesGetTestJSON-289301174 tempest-VolumesGetTestJSON-289301174-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/15b7dac1-5977-4921-97a2-2edfd7774b04" status: 200 len: 353 microversion: 2.1 time: 0.101051 Sep 02 05:23:07.457558 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 4/7] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Sep 2 05:23:07 2022] GET /compute/v2.1/os-volumes/15b7dac1-5977-4921-97a2-2edfd7774b04 => generated 353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:23:08.472765 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-80eb3dc2-5e3c-44d6-943f-d7722211c42d tempest-VolumesGetTestJSON-289301174 tempest-VolumesGetTestJSON-289301174-project] Calling method '.version_select at 0x7fc90c21fd30>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:08.577549 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-80eb3dc2-5e3c-44d6-943f-d7722211c42d tempest-VolumesGetTestJSON-289301174 tempest-VolumesGetTestJSON-289301174-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/15b7dac1-5977-4921-97a2-2edfd7774b04" status: 200 len: 353 microversion: 2.1 time: 0.110324 Sep 02 05:23:08.583653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 4/8] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Sep 2 05:23:08 2022] GET /compute/v2.1/os-volumes/15b7dac1-5977-4921-97a2-2edfd7774b04 => generated 353 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:23:09.299619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-0137f994-a749-4424-a7d1-b15c1bc1030f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Action: 'create', calling method: .version_select at 0x7fc90c1ede50>, body: {"keypair": {"name": "tempest-keypair-1072050948", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuHZBa+X+vxtfh0UVTmEa8NiazB2QVgTyh+RvcpzKDRwYxr2p0/ynE7nTDmbAk/iP8RGQ6Fr3wHOE5VpCsAmMhhbACQLUXmU5lUnuGpp5N32STb/U0p5dcCAj2Nc3CChg=="}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:23:09.418579 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-0137f994-a749-4424-a7d1-b15c1bc1030f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Getting quotas for project 0847ca942df54b659e8723463ab72c65. Resources: {'key_pairs'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:23:09.426727 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-0137f994-a749-4424-a7d1-b15c1bc1030f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Getting quotas for user ee1a3027b52f4b46bc5cff18f9cd0b02 and project 0847ca942df54b659e8723463ab72c65. Resources: {'key_pairs'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:23:09.506202 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-0137f994-a749-4424-a7d1-b15c1bc1030f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.283984 Sep 02 05:23:09.507470 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 5/9] 10.222.0.30 () {60 vars in 1159 bytes} [Fri Sep 2 05:23:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:23:09.602688 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-365992f9-537c-47ee-a58e-46842caa1088 tempest-VolumesGetTestJSON-289301174 tempest-VolumesGetTestJSON-289301174-project] Calling method '.version_select at 0x7fc90c1e7430>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:09.741019 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-365992f9-537c-47ee-a58e-46842caa1088 tempest-VolumesGetTestJSON-289301174 tempest-VolumesGetTestJSON-289301174-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/15b7dac1-5977-4921-97a2-2edfd7774b04" status: 200 len: 353 microversion: 2.1 time: 0.153906 Sep 02 05:23:09.741593 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 5/10] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Sep 2 05:23:09 2022] GET /compute/v2.1/os-volumes/15b7dac1-5977-4921-97a2-2edfd7774b04 => generated 353 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:23:10.756720 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-e5e51b40-aaf5-424b-8655-172b13604c90 tempest-VolumesGetTestJSON-289301174 tempest-VolumesGetTestJSON-289301174-project] Calling method '.version_select at 0x7fc90c15cc10>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:10.872229 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-e5e51b40-aaf5-424b-8655-172b13604c90 tempest-VolumesGetTestJSON-289301174 tempest-VolumesGetTestJSON-289301174-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/15b7dac1-5977-4921-97a2-2edfd7774b04" status: 200 len: 353 microversion: 2.1 time: 0.120913 Sep 02 05:23:10.872825 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 6/11] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Sep 2 05:23:10 2022] GET /compute/v2.1/os-volumes/15b7dac1-5977-4921-97a2-2edfd7774b04 => generated 353 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:23:11.889884 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-0438ad67-d2fe-4a4a-96a6-2cada101e106 tempest-VolumesGetTestJSON-289301174 tempest-VolumesGetTestJSON-289301174-project] Calling method '.version_select at 0x7fc90c21fd30>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:12.026709 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-b77519a4-83c6-4063-8ad7-ed429e90a2e3 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-497730890", "imageRef": "f3669111-2e3f-4f39-878f-19d263505eaa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64176975-8c6d-4d21-8413-773e395248ec"}], "security_groups": [{"name": "tempest-securitygroup--684569717"}], "key_name": "tempest-keypair-1072050948", "user_data": "}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:23:12.041929 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-0438ad67-d2fe-4a4a-96a6-2cada101e106 tempest-VolumesGetTestJSON-289301174 tempest-VolumesGetTestJSON-289301174-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/15b7dac1-5977-4921-97a2-2edfd7774b04" status: 200 len: 353 microversion: 2.1 time: 0.159709 Sep 02 05:23:12.043554 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 6/12] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Sep 2 05:23:11 2022] GET /compute/v2.1/os-volumes/15b7dac1-5977-4921-97a2-2edfd7774b04 => generated 353 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:23:12.277328 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.network.neutron [None req-b77519a4-83c6-4063-8ad7-ed429e90a2e3 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] validate_networks() for [('64176975-8c6d-4d21-8413-773e395248ec', None, None, None, None, None)] {{(pid=120448) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 05:23:13.056844 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-07ff6f92-db4e-4d8f-bb9f-a9f8ca05aa9f tempest-VolumesGetTestJSON-289301174 tempest-VolumesGetTestJSON-289301174-project] Calling method '.version_select at 0x7fc90c21f700>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:13.142419 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-07ff6f92-db4e-4d8f-bb9f-a9f8ca05aa9f tempest-VolumesGetTestJSON-289301174 tempest-VolumesGetTestJSON-289301174-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/15b7dac1-5977-4921-97a2-2edfd7774b04" status: 200 len: 353 microversion: 2.1 time: 0.088811 Sep 02 05:23:13.153564 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 7/13] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Sep 2 05:23:13 2022] GET /compute/v2.1/os-volumes/15b7dac1-5977-4921-97a2-2edfd7774b04 => generated 353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 05:23:13.934015 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-b77519a4-83c6-4063-8ad7-ed429e90a2e3 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Flavor limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 05:23:13.934636 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-b77519a4-83c6-4063-8ad7-ed429e90a2e3 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Image limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 05:23:13.934946 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-b77519a4-83c6-4063-8ad7-ed429e90a2e3 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Flavor pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 05:23:13.935353 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-b77519a4-83c6-4063-8ad7-ed429e90a2e3 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Image pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 05:23:13.935766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-b77519a4-83c6-4063-8ad7-ed429e90a2e3 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 05:23:13.955237 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b77519a4-83c6-4063-8ad7-ed429e90a2e3 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:13.955732 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b77519a4-83c6-4063-8ad7-ed429e90a2e3 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:13.956197 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b77519a4-83c6-4063-8ad7-ed429e90a2e3 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:13.956923 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b77519a4-83c6-4063-8ad7-ed429e90a2e3 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:13.957380 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b77519a4-83c6-4063-8ad7-ed429e90a2e3 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:13.957809 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b77519a4-83c6-4063-8ad7-ed429e90a2e3 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:14.012204 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-62e60d73-2b5f-4ac7-819f-16ac84885d90 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-244001279", "imageRef": "f3669111-2e3f-4f39-878f-19d263505eaa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:23:14.035982 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-b77519a4-83c6-4063-8ad7-ed429e90a2e3 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Getting quotas for project 0847ca942df54b659e8723463ab72c65. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:23:14.043522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-b77519a4-83c6-4063-8ad7-ed429e90a2e3 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Getting quotas for user ee1a3027b52f4b46bc5cff18f9cd0b02 and project 0847ca942df54b659e8723463ab72c65. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:23:14.066765 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-b77519a4-83c6-4063-8ad7-ed429e90a2e3 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Going to run 1 instances... {{(pid=120448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 05:23:14.070138 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-b77519a4-83c6-4063-8ad7-ed429e90a2e3 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3669111-2e3f-4f39-878f-19d263505eaa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 05:23:14.188032 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-b77519a4-83c6-4063-8ad7-ed429e90a2e3 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.165832 Sep 02 05:23:14.189070 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 7/14] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Sep 2 05:23:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 2169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 02 05:23:14.202390 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-003062a7-bc48-4e2e-8458-cb768c423861 tempest-VolumesGetTestJSON-289301174 tempest-VolumesGetTestJSON-289301174-project] Calling method '.version_select at 0x7fc90c0b2dc0>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:14.320652 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.network.neutron [None req-62e60d73-2b5f-4ac7-819f-16ac84885d90 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] validate_networks() for [('fa2d68b0-bcd1-4b10-afa0-f7eeee0cab08', None, None, None, None, None)] {{(pid=120449) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 05:23:14.382373 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.wsgi [None req-003062a7-bc48-4e2e-8458-cb768c423861 tempest-VolumesGetTestJSON-289301174 tempest-VolumesGetTestJSON-289301174-project] HTTP exception thrown: Volume 15b7dac1-5977-4921-97a2-2edfd7774b04 could not be found. Sep 02 05:23:14.391113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-003062a7-bc48-4e2e-8458-cb768c423861 tempest-VolumesGetTestJSON-289301174 tempest-VolumesGetTestJSON-289301174-project] Request method failure captured: Sep 02 05:23:14.391113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: request: GET /compute/v2.1/os-volumes/15b7dac1-5977-4921-97a2-2edfd7774b04 HTTP/1.1 Sep 02 05:23:14.391113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept: application/json Sep 02 05:23:14.391113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept-Encoding: identity Sep 02 05:23:14.391113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Connection: close Sep 02 05:23:14.391113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Length: 0 Sep 02 05:23:14.391113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Type: application/json Sep 02 05:23:14.391113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Host: 10.222.0.30 Sep 02 05:23:14.391113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Openstack-System-Scope: None Sep 02 05:23:14.391113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: User-Agent: python-urllib3/1.26.12 Sep 02 05:23:14.391113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Auth-Token: gAAAAABjEZM2FehRi1l3NfebKj_oPdJtntNIGAA9f_f83BQ7mKr9xvj_HtaXVhJitH4FANkQWzojQPpD-MEv0ygnPVPSIlDNPNKiHuLntF9yAF3evemHZgDpB4xyb7QgKMbCrBgyXTmcw4va8VoTDtbC7VXJLuE6-uDEbSIv6CWauwbr9ZukAuE Sep 02 05:23:14.391113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Id: None Sep 02 05:23:14.391113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Name: None Sep 02 05:23:14.391113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Identity-Status: Confirmed Sep 02 05:23:14.391113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Is-Admin-Project: True Sep 02 05:23:14.391113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Id: default Sep 02 05:23:14.391113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Name: Default Sep 02 05:23:14.391113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Id: 5f8667124d814bed94654e44018fbba4 Sep 02 05:23:14.391113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Name: tempest-VolumesGetTestJSON-289301174 Sep 02 05:23:14.391113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Role: member,reader Sep 02 05:23:14.391113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Roles: member,reader Sep 02 05:23:14.392298 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5f8667124d814bed94654e44018fbba4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5f8667124d814bed94654e44018fbba4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5f8667124d814bed94654e44018fbba4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5f8667124d814bed94654e44018fbba4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:23:14.392298 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant: tempest-VolumesGetTestJSON-289301174 Sep 02 05:23:14.392298 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Id: 5f8667124d814bed94654e44018fbba4 Sep 02 05:23:14.392298 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Name: tempest-VolumesGetTestJSON-289301174 Sep 02 05:23:14.392298 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User: tempest-VolumesGetTestJSON-289301174-project Sep 02 05:23:14.392298 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Id: default Sep 02 05:23:14.392298 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Name: Default Sep 02 05:23:14.392298 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Id: edc807c329954568a8ec8e04d6b03d24 Sep 02 05:23:14.392298 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Name: tempest-VolumesGetTestJSON-289301174-project Sep 02 05:23:14.392298 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: method: Sep 02 05:23:14.392298 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: exception: Volume 15b7dac1-5977-4921-97a2-2edfd7774b04 could not be found. Sep 02 05:23:14.392298 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: action_args: {'id': '15b7dac1-5977-4921-97a2-2edfd7774b04'} Sep 02 05:23:14.392298 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:23:14.393464 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:23:14.393464 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 05:23:14.393464 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 05:23:14.393464 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 05:23:14.393464 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 05:23:14.393464 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 05:23:14.393464 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 05:23:14.393464 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 05:23:14.393464 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 05:23:14.393464 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 05:23:14.393464 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 05:23:14.393464 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 05:23:14.393464 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 05:23:14.393464 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 05:23:14.393464 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 05:23:14.393464 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 15b7dac1-5977-4921-97a2-2edfd7774b04 could not be found. (HTTP 404) (Request-ID: req-0991d7fe-819a-4b10-9cad-359c0d8b7b92) Sep 02 05:23:14.393464 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:23:14.393464 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:23:14.393464 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:23:14.394624 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:23:14.394624 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 02 05:23:14.394624 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 02 05:23:14.394624 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 05:23:14.394624 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 05:23:14.394624 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 05:23:14.394624 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 05:23:14.394624 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 05:23:14.394624 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 05:23:14.394624 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 05:23:14.394624 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 05:23:14.394624 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 05:23:14.394624 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 05:23:14.394624 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 05:23:14.394624 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 05:23:14.394624 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 05:23:14.394624 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 05:23:14.394624 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 05:23:14.394624 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 05:23:14.396070 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 05:23:14.396070 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 05:23:14.396070 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 05:23:14.396070 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 05:23:14.396070 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 15b7dac1-5977-4921-97a2-2edfd7774b04 could not be found. Sep 02 05:23:14.396070 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:23:14.396070 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:23:14.396070 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:23:14.396070 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:23:14.396070 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:23:14.396070 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:23:14.396070 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:23:14.396070 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:23:14.396070 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 05:23:14.396070 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 05:23:14.396070 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:23:14.396070 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:23:14.396070 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 02 05:23:14.396070 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:23:14.397071 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 15b7dac1-5977-4921-97a2-2edfd7774b04 could not be found. Sep 02 05:23:14.397071 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:23:14.397071 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:23:14.397071 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:23:14.397071 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:23:14.397071 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:23:14.397071 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:23:14.397071 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:23:14.397071 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:23:14.397071 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 15b7dac1-5977-4921-97a2-2edfd7774b04 could not be found. Sep 02 05:23:14.397071 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:23:14.400657 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-003062a7-bc48-4e2e-8458-cb768c423861 tempest-VolumesGetTestJSON-289301174 tempest-VolumesGetTestJSON-289301174-project] Returning 404 to user: Volume 15b7dac1-5977-4921-97a2-2edfd7774b04 could not be found. {{(pid=120448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:23:14.405692 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-003062a7-bc48-4e2e-8458-cb768c423861 tempest-VolumesGetTestJSON-289301174 tempest-VolumesGetTestJSON-289301174-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/15b7dac1-5977-4921-97a2-2edfd7774b04" status: 404 len: 109 microversion: 2.1 time: 0.211182 Sep 02 05:23:14.422513 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 8/15] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Sep 2 05:23:14 2022] GET /compute/v2.1/os-volumes/15b7dac1-5977-4921-97a2-2edfd7774b04 => generated 109 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:23:14.464985 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f22642e3-3567-4411-b710-7e0d1a5b7c66 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:14.470101 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f22642e3-3567-4411-b710-7e0d1a5b7c66 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:14.837254 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f22642e3-3567-4411-b710-7e0d1a5b7c66 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:14.876527 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f22642e3-3567-4411-b710-7e0d1a5b7c66 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1241 microversion: 2.1 time: 0.446015 Sep 02 05:23:14.876527 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 9/16] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:14 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1241 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:14.953002 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-0a85ca37-c3a7-4a93-a6bd-d70cfce5f260 tempest-VolumesTestJSON-1314767656 tempest-VolumesTestJSON-1314767656-project] Calling method '.version_select at 0x7fc90b83c040>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:15.072924 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-0a85ca37-c3a7-4a93-a6bd-d70cfce5f260 tempest-VolumesTestJSON-1314767656 tempest-VolumesTestJSON-1314767656-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2d238627-f08a-4623-8402-3c3fcfe3adf9" status: 200 len: 350 microversion: 2.1 time: 0.123820 Sep 02 05:23:15.081400 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 10/17] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Sep 2 05:23:14 2022] GET /compute/v2.1/os-volumes/2d238627-f08a-4623-8402-3c3fcfe3adf9 => generated 350 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:23:15.894958 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-b2ce01ca-c87d-4c06-90ca-2d53e30d9418 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:15.895963 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-b2ce01ca-c87d-4c06-90ca-2d53e30d9418 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:16.093014 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.virt.hardware [None req-62e60d73-2b5f-4ac7-819f-16ac84885d90 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Flavor limits 0:0:0 {{(pid=120449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 05:23:16.094088 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.virt.hardware [None req-62e60d73-2b5f-4ac7-819f-16ac84885d90 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Image limits 0:0:0 {{(pid=120449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 05:23:16.095389 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.virt.hardware [None req-62e60d73-2b5f-4ac7-819f-16ac84885d90 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Flavor pref 0:0:0 {{(pid=120449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 05:23:16.095983 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.virt.hardware [None req-62e60d73-2b5f-4ac7-819f-16ac84885d90 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Image pref 0:0:0 {{(pid=120449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 05:23:16.096563 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.virt.hardware [None req-62e60d73-2b5f-4ac7-819f-16ac84885d90 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 05:23:16.133383 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-62e60d73-2b5f-4ac7-819f-16ac84885d90 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:16.137203 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-62e60d73-2b5f-4ac7-819f-16ac84885d90 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:16.137719 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-62e60d73-2b5f-4ac7-819f-16ac84885d90 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:16.140156 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-62e60d73-2b5f-4ac7-819f-16ac84885d90 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:16.141718 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-62e60d73-2b5f-4ac7-819f-16ac84885d90 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:16.145344 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-62e60d73-2b5f-4ac7-819f-16ac84885d90 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:16.174734 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-b2ce01ca-c87d-4c06-90ca-2d53e30d9418 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:16.189612 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-b2ce01ca-c87d-4c06-90ca-2d53e30d9418 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1241 microversion: 2.1 time: 0.296527 Sep 02 05:23:16.197143 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 11/18] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:15 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1241 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:23:16.221351 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.quota [None req-62e60d73-2b5f-4ac7-819f-16ac84885d90 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Getting quotas for project 8eb15e49aead4c2987f1ac32180db505. Resources: {'ram', 'instances', 'cores'} {{(pid=120449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:23:16.244778 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.quota [None req-62e60d73-2b5f-4ac7-819f-16ac84885d90 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Getting quotas for user d27e9069d6c4406292c48ea81b2bc78a and project 8eb15e49aead4c2987f1ac32180db505. Resources: {'ram', 'instances', 'cores'} {{(pid=120449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:23:16.278660 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-62e60d73-2b5f-4ac7-819f-16ac84885d90 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Going to run 1 instances... {{(pid=120449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 05:23:16.282689 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-62e60d73-2b5f-4ac7-819f-16ac84885d90 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3669111-2e3f-4f39-878f-19d263505eaa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 05:23:16.452631 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-62e60d73-2b5f-4ac7-819f-16ac84885d90 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.600659 Sep 02 05:23:16.455101 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 8/19] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Sep 2 05:23:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 2604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 05:23:16.468261 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-21b60059-bf89-480b-bff2-188aa5d2d395 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:16.470183 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-21b60059-bf89-480b-bff2-188aa5d2d395 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:16.581007 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-21b60059-bf89-480b-bff2-188aa5d2d395 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:16.589397 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-21b60059-bf89-480b-bff2-188aa5d2d395 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1221 microversion: 2.1 time: 0.126550 Sep 02 05:23:16.607494 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 12/20] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:16 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1221 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:16.800931 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-c1e61761-240e-4992-aea2-695016f49477 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-784717970", "imageRef": "f3669111-2e3f-4f39-878f-19d263505eaa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:23:16.973404 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.network.neutron [None req-c1e61761-240e-4992-aea2-695016f49477 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] validate_networks() for [('fa2d68b0-bcd1-4b10-afa0-f7eeee0cab08', None, None, None, None, None)] {{(pid=120449) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 05:23:17.215929 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-5fa75b13-d0a9-4810-a341-8c6a35b07d53 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:17.216675 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-5fa75b13-d0a9-4810-a341-8c6a35b07d53 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:17.229535 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5fa75b13-d0a9-4810-a341-8c6a35b07d53 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:17.230157 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5fa75b13-d0a9-4810-a341-8c6a35b07d53 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:17.230487 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5fa75b13-d0a9-4810-a341-8c6a35b07d53 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:17.231220 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5fa75b13-d0a9-4810-a341-8c6a35b07d53 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:17.250706 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5fa75b13-d0a9-4810-a341-8c6a35b07d53 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:17.251279 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5fa75b13-d0a9-4810-a341-8c6a35b07d53 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:17.841150 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-5fa75b13-d0a9-4810-a341-8c6a35b07d53 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:17.858181 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-5fa75b13-d0a9-4810-a341-8c6a35b07d53 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1245 microversion: 2.1 time: 0.649544 Sep 02 05:23:17.858771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 13/21] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:17 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1245 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:18.320478 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.virt.hardware [None req-c1e61761-240e-4992-aea2-695016f49477 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Flavor limits 0:0:0 {{(pid=120449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 05:23:18.320984 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.virt.hardware [None req-c1e61761-240e-4992-aea2-695016f49477 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Image limits 0:0:0 {{(pid=120449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 05:23:18.321438 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.virt.hardware [None req-c1e61761-240e-4992-aea2-695016f49477 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Flavor pref 0:0:0 {{(pid=120449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 05:23:18.323400 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.virt.hardware [None req-c1e61761-240e-4992-aea2-695016f49477 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Image pref 0:0:0 {{(pid=120449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 05:23:18.323881 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.virt.hardware [None req-c1e61761-240e-4992-aea2-695016f49477 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 05:23:18.346895 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c1e61761-240e-4992-aea2-695016f49477 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:18.348663 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c1e61761-240e-4992-aea2-695016f49477 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:18.350316 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c1e61761-240e-4992-aea2-695016f49477 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:18.354617 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c1e61761-240e-4992-aea2-695016f49477 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:18.356572 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c1e61761-240e-4992-aea2-695016f49477 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:18.358574 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c1e61761-240e-4992-aea2-695016f49477 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:18.413524 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.quota [None req-c1e61761-240e-4992-aea2-695016f49477 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Getting quotas for project 8eb15e49aead4c2987f1ac32180db505. Resources: {'ram', 'instances', 'cores'} {{(pid=120449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:23:18.425019 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.quota [None req-c1e61761-240e-4992-aea2-695016f49477 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Getting quotas for user d27e9069d6c4406292c48ea81b2bc78a and project 8eb15e49aead4c2987f1ac32180db505. Resources: {'ram', 'instances', 'cores'} {{(pid=120449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:23:18.462746 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-c1e61761-240e-4992-aea2-695016f49477 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Going to run 1 instances... {{(pid=120449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 05:23:18.465181 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-c1e61761-240e-4992-aea2-695016f49477 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3669111-2e3f-4f39-878f-19d263505eaa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 05:23:18.579742 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-c1e61761-240e-4992-aea2-695016f49477 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.786204 Sep 02 05:23:18.581026 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 9/22] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Sep 2 05:23:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 1789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 05:23:18.592677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-a5a13246-80fc-4047-87bf-803e27148b0d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:18.593404 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-a5a13246-80fc-4047-87bf-803e27148b0d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:18.706985 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-a5a13246-80fc-4047-87bf-803e27148b0d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:18.718557 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-a5a13246-80fc-4047-87bf-803e27148b0d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1221 microversion: 2.1 time: 0.130658 Sep 02 05:23:18.722476 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 14/23] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:18 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1221 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:18.879452 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-3c8e3339-3ed1-4075-a7a9-64d08fef4e60 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:18.880078 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-3c8e3339-3ed1-4075-a7a9-64d08fef4e60 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:18.902179 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3c8e3339-3ed1-4075-a7a9-64d08fef4e60 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:18.902677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3c8e3339-3ed1-4075-a7a9-64d08fef4e60 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:18.907855 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3c8e3339-3ed1-4075-a7a9-64d08fef4e60 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:18.909684 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3c8e3339-3ed1-4075-a7a9-64d08fef4e60 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:18.910357 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3c8e3339-3ed1-4075-a7a9-64d08fef4e60 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:18.915278 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3c8e3339-3ed1-4075-a7a9-64d08fef4e60 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:19.101203 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-3c8e3339-3ed1-4075-a7a9-64d08fef4e60 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:19.110592 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-3c8e3339-3ed1-4075-a7a9-64d08fef4e60 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1245 microversion: 2.1 time: 0.235349 Sep 02 05:23:19.114153 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 15/24] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:18 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1245 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:23:19.478656 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-7a7c32b0-6864-4912-9efa-651488fac310 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-169432378", "imageRef": "f3669111-2e3f-4f39-878f-19d263505eaa", "flavorRef": "452", "networks": [{"uuid": "a6af8ba4-d8f1-42ed-8d09-cc9e65a7c05f"}]}} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:23:19.626878 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.network.neutron [None req-7a7c32b0-6864-4912-9efa-651488fac310 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] validate_networks() for [('a6af8ba4-d8f1-42ed-8d09-cc9e65a7c05f', None, None, None, None, None)] {{(pid=120449) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 05:23:19.741680 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-310f0747-06a0-4718-aff8-f28da1d1e2cf tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:19.742091 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-310f0747-06a0-4718-aff8-f28da1d1e2cf tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:19.753273 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-310f0747-06a0-4718-aff8-f28da1d1e2cf tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:19.753992 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-310f0747-06a0-4718-aff8-f28da1d1e2cf tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:19.754579 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-310f0747-06a0-4718-aff8-f28da1d1e2cf tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:19.755440 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-310f0747-06a0-4718-aff8-f28da1d1e2cf tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:19.756041 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-310f0747-06a0-4718-aff8-f28da1d1e2cf tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:19.756639 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-310f0747-06a0-4718-aff8-f28da1d1e2cf tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:19.878012 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-310f0747-06a0-4718-aff8-f28da1d1e2cf tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:19.886553 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-310f0747-06a0-4718-aff8-f28da1d1e2cf tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1225 microversion: 2.1 time: 0.149116 Sep 02 05:23:19.887343 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 16/25] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:19 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1225 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:23:20.138951 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-82994878-292c-423d-81a0-01eccccf73b9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Action: 'create', calling method: .version_select at 0x7fc90b7da0d0>, body: {"keypair": {"name": "tempest-keypair-1595938782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOrbkjO4WNMinXHWHML4T5bhWsTqFA5tnCbPo8YdVT6IruPYaQJhi2yJhu49VYGvZmyCoPHnAplwMBQxYSMmLbv8KgVpvJweEJlWfMwP2PCrNxhm6Qq84laUcN0468QZjg=="}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:23:20.160509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-82994878-292c-423d-81a0-01eccccf73b9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Getting quotas for project 11ca1d5cfab24589b53707dea9790e26. Resources: {'key_pairs'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:23:20.172640 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-82994878-292c-423d-81a0-01eccccf73b9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Getting quotas for user f47ca04b60554047b0541de359bafd26 and project 11ca1d5cfab24589b53707dea9790e26. Resources: {'key_pairs'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:23:20.178892 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.virt.hardware [None req-7a7c32b0-6864-4912-9efa-651488fac310 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Flavor limits 0:0:0 {{(pid=120449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 05:23:20.179409 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.virt.hardware [None req-7a7c32b0-6864-4912-9efa-651488fac310 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Image limits 0:0:0 {{(pid=120449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 05:23:20.180006 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.virt.hardware [None req-7a7c32b0-6864-4912-9efa-651488fac310 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Flavor pref 0:0:0 {{(pid=120449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 05:23:20.180626 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.virt.hardware [None req-7a7c32b0-6864-4912-9efa-651488fac310 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Image pref 0:0:0 {{(pid=120449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 05:23:20.181360 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.virt.hardware [None req-7a7c32b0-6864-4912-9efa-651488fac310 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 05:23:20.195841 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7a7c32b0-6864-4912-9efa-651488fac310 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:20.196358 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7a7c32b0-6864-4912-9efa-651488fac310 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:20.196939 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7a7c32b0-6864-4912-9efa-651488fac310 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:20.198173 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7a7c32b0-6864-4912-9efa-651488fac310 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:20.198651 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7a7c32b0-6864-4912-9efa-651488fac310 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:20.199154 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7a7c32b0-6864-4912-9efa-651488fac310 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:20.205398 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-82994878-292c-423d-81a0-01eccccf73b9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.316093 Sep 02 05:23:20.206623 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 17/26] 10.222.0.30 () {62 vars in 1200 bytes} [Fri Sep 2 05:23:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 318 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 02 05:23:20.211730 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-6ef05558-991c-4bda-9dff-b22f8e7a4563 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:20.212614 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-6ef05558-991c-4bda-9dff-b22f8e7a4563 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:20.221099 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6ef05558-991c-4bda-9dff-b22f8e7a4563 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:20.221903 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6ef05558-991c-4bda-9dff-b22f8e7a4563 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:20.223086 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6ef05558-991c-4bda-9dff-b22f8e7a4563 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:20.224466 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6ef05558-991c-4bda-9dff-b22f8e7a4563 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:20.225309 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6ef05558-991c-4bda-9dff-b22f8e7a4563 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:20.231765 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6ef05558-991c-4bda-9dff-b22f8e7a4563 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:20.255181 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.quota [None req-7a7c32b0-6864-4912-9efa-651488fac310 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Getting quotas for project 60ad0d3adab048ae90a0c7f64d75b61d. Resources: {'ram', 'instances', 'cores'} {{(pid=120449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:23:20.265581 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.quota [None req-7a7c32b0-6864-4912-9efa-651488fac310 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Getting quotas for user 6e72a813c51e499883779df76996a7b1 and project 60ad0d3adab048ae90a0c7f64d75b61d. Resources: {'ram', 'instances', 'cores'} {{(pid=120449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:23:20.301866 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-7a7c32b0-6864-4912-9efa-651488fac310 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Going to run 1 instances... {{(pid=120449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 05:23:20.308897 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-7a7c32b0-6864-4912-9efa-651488fac310 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3669111-2e3f-4f39-878f-19d263505eaa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 05:23:20.380842 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-6ef05558-991c-4bda-9dff-b22f8e7a4563 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:20.395595 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-6ef05558-991c-4bda-9dff-b22f8e7a4563 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1293 microversion: 2.1 time: 0.187163 Sep 02 05:23:20.397271 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 18/27] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:20 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1293 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:20.438228 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-7a7c32b0-6864-4912-9efa-651488fac310 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.580895 Sep 02 05:23:20.439365 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 10/28] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Sep 2 05:23:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 05:23:20.454063 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-dfc6dc74-df39-48b8-a06f-ee18f7fcabe7 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:20.454829 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-dfc6dc74-df39-48b8-a06f-ee18f7fcabe7 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:20.594252 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-dfc6dc74-df39-48b8-a06f-ee18f7fcabe7 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:20.608138 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-dfc6dc74-df39-48b8-a06f-ee18f7fcabe7 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1214 microversion: 2.1 time: 0.156620 Sep 02 05:23:20.620297 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 19/29] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:20 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1214 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:20.908614 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5934085b-2de8-4738-ac1c-cb83b5753aa5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:20.909244 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5934085b-2de8-4738-ac1c-cb83b5753aa5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:20.952867 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5934085b-2de8-4738-ac1c-cb83b5753aa5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:20.953390 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5934085b-2de8-4738-ac1c-cb83b5753aa5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:20.953904 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5934085b-2de8-4738-ac1c-cb83b5753aa5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:20.959541 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5934085b-2de8-4738-ac1c-cb83b5753aa5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:20.960459 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5934085b-2de8-4738-ac1c-cb83b5753aa5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:20.961245 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5934085b-2de8-4738-ac1c-cb83b5753aa5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:21.346450 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5934085b-2de8-4738-ac1c-cb83b5753aa5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:21.419667 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-777fd59f-b40c-42a1-9667-472f47cc9bd2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:21.420334 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-777fd59f-b40c-42a1-9667-472f47cc9bd2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:21.424926 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5934085b-2de8-4738-ac1c-cb83b5753aa5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1217 microversion: 2.1 time: 0.521632 Sep 02 05:23:21.425527 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 11/30] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:20 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1217 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:21.438402 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-777fd59f-b40c-42a1-9667-472f47cc9bd2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:21.439136 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-777fd59f-b40c-42a1-9667-472f47cc9bd2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:21.439611 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-777fd59f-b40c-42a1-9667-472f47cc9bd2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:21.440447 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-777fd59f-b40c-42a1-9667-472f47cc9bd2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:21.440894 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-777fd59f-b40c-42a1-9667-472f47cc9bd2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:21.441325 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-777fd59f-b40c-42a1-9667-472f47cc9bd2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:21.568536 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-777fd59f-b40c-42a1-9667-472f47cc9bd2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:21.596991 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-777fd59f-b40c-42a1-9667-472f47cc9bd2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1293 microversion: 2.1 time: 0.180041 Sep 02 05:23:21.597845 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 20/31] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:21 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1293 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:21.633942 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-a94544d5-c734-41d6-b765-fef4724d4cbb tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:21.634576 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-a94544d5-c734-41d6-b765-fef4724d4cbb tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:21.642903 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a94544d5-c734-41d6-b765-fef4724d4cbb tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:21.643403 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a94544d5-c734-41d6-b765-fef4724d4cbb tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:21.648829 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a94544d5-c734-41d6-b765-fef4724d4cbb tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:21.650849 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a94544d5-c734-41d6-b765-fef4724d4cbb tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:21.651344 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a94544d5-c734-41d6-b765-fef4724d4cbb tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:21.651788 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a94544d5-c734-41d6-b765-fef4724d4cbb tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:21.757283 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-a94544d5-c734-41d6-b765-fef4724d4cbb tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:21.768588 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-a94544d5-c734-41d6-b765-fef4724d4cbb tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1218 microversion: 2.1 time: 0.137951 Sep 02 05:23:21.769309 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 12/32] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:21 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1218 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:22.449078 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-135a8aaf-9049-4ca1-8f58-72c5244e123e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:22.449851 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-135a8aaf-9049-4ca1-8f58-72c5244e123e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:22.455835 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-135a8aaf-9049-4ca1-8f58-72c5244e123e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:22.456368 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-135a8aaf-9049-4ca1-8f58-72c5244e123e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:22.456811 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-135a8aaf-9049-4ca1-8f58-72c5244e123e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:22.457881 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-135a8aaf-9049-4ca1-8f58-72c5244e123e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:22.458351 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-135a8aaf-9049-4ca1-8f58-72c5244e123e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:22.458806 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-135a8aaf-9049-4ca1-8f58-72c5244e123e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:22.541338 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-135a8aaf-9049-4ca1-8f58-72c5244e123e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:22.551353 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-135a8aaf-9049-4ca1-8f58-72c5244e123e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1217 microversion: 2.1 time: 0.107395 Sep 02 05:23:22.552396 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 21/33] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:22 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1217 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:22.617872 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-a160bbf9-0fe0-4fbe-9231-27f117ee2c0f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:22.618574 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-a160bbf9-0fe0-4fbe-9231-27f117ee2c0f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:22.624903 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a160bbf9-0fe0-4fbe-9231-27f117ee2c0f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:22.625391 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a160bbf9-0fe0-4fbe-9231-27f117ee2c0f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:22.625881 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a160bbf9-0fe0-4fbe-9231-27f117ee2c0f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:22.626649 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a160bbf9-0fe0-4fbe-9231-27f117ee2c0f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:22.627415 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a160bbf9-0fe0-4fbe-9231-27f117ee2c0f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:22.627980 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a160bbf9-0fe0-4fbe-9231-27f117ee2c0f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:22.645808 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-267aa96a-7370-4d25-a920-beb00724f81c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-522958206", "imageRef": "f3669111-2e3f-4f39-878f-19d263505eaa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fd2f8a24-ffb3-408a-a457-eed06f87f871"}], "security_groups": [{"name": "tempest-securitygroup--48783054"}], "key_name": "tempest-keypair-1595938782", "user_data": "}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:23:22.706709 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-a160bbf9-0fe0-4fbe-9231-27f117ee2c0f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:22.714582 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-a160bbf9-0fe0-4fbe-9231-27f117ee2c0f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1293 microversion: 2.1 time: 0.100477 Sep 02 05:23:22.716159 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 13/34] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:22 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1293 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:22.783987 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.network.neutron [None req-267aa96a-7370-4d25-a920-beb00724f81c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] validate_networks() for [('fd2f8a24-ffb3-408a-a457-eed06f87f871', None, None, None, None, None)] {{(pid=120448) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 05:23:22.790167 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-55219cf9-da34-4010-8518-87ec276adbc2 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:22.790873 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-55219cf9-da34-4010-8518-87ec276adbc2 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:22.801404 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-55219cf9-da34-4010-8518-87ec276adbc2 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:22.802118 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-55219cf9-da34-4010-8518-87ec276adbc2 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:22.802701 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-55219cf9-da34-4010-8518-87ec276adbc2 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:22.805060 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-55219cf9-da34-4010-8518-87ec276adbc2 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:22.805546 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-55219cf9-da34-4010-8518-87ec276adbc2 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:22.805990 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-55219cf9-da34-4010-8518-87ec276adbc2 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:22.918034 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-55219cf9-da34-4010-8518-87ec276adbc2 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:22.926118 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-55219cf9-da34-4010-8518-87ec276adbc2 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1218 microversion: 2.1 time: 0.140310 Sep 02 05:23:22.926721 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 14/35] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:22 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1218 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:23:23.385535 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-267aa96a-7370-4d25-a920-beb00724f81c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Flavor limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 05:23:23.386146 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-267aa96a-7370-4d25-a920-beb00724f81c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Image limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 05:23:23.386619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-267aa96a-7370-4d25-a920-beb00724f81c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Flavor pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 05:23:23.387345 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-267aa96a-7370-4d25-a920-beb00724f81c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Image pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 05:23:23.387863 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-267aa96a-7370-4d25-a920-beb00724f81c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 05:23:23.396788 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-267aa96a-7370-4d25-a920-beb00724f81c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:23.397381 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-267aa96a-7370-4d25-a920-beb00724f81c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:23.397683 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-267aa96a-7370-4d25-a920-beb00724f81c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:23.399942 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-267aa96a-7370-4d25-a920-beb00724f81c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:23.399942 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-267aa96a-7370-4d25-a920-beb00724f81c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:23.399942 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-267aa96a-7370-4d25-a920-beb00724f81c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:23.419525 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-267aa96a-7370-4d25-a920-beb00724f81c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Getting quotas for project 11ca1d5cfab24589b53707dea9790e26. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:23:23.424088 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-267aa96a-7370-4d25-a920-beb00724f81c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Getting quotas for user f47ca04b60554047b0541de359bafd26 and project 11ca1d5cfab24589b53707dea9790e26. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:23:23.453229 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-267aa96a-7370-4d25-a920-beb00724f81c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Going to run 1 instances... {{(pid=120448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 05:23:23.456350 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-267aa96a-7370-4d25-a920-beb00724f81c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3669111-2e3f-4f39-878f-19d263505eaa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 05:23:23.534416 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-267aa96a-7370-4d25-a920-beb00724f81c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.892771 Sep 02 05:23:23.540152 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 22/36] 10.222.0.30 () {62 vars in 1188 bytes} [Fri Sep 2 05:23:22 2022] POST /compute/v2.1/servers => generated 400 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 02 05:23:23.551212 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-f36fe307-f7c2-440f-a521-720f7837d922 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:23.552645 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-f36fe307-f7c2-440f-a521-720f7837d922 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:23.571992 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-df2e5f96-d4d9-4114-bba3-c5a417b3ba06 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:23.572640 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-df2e5f96-d4d9-4114-bba3-c5a417b3ba06 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:23.592899 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-df2e5f96-d4d9-4114-bba3-c5a417b3ba06 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:23.593406 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-df2e5f96-d4d9-4114-bba3-c5a417b3ba06 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:23.600520 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-df2e5f96-d4d9-4114-bba3-c5a417b3ba06 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:23.601300 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-df2e5f96-d4d9-4114-bba3-c5a417b3ba06 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:23.601775 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-df2e5f96-d4d9-4114-bba3-c5a417b3ba06 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:23.602216 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-df2e5f96-d4d9-4114-bba3-c5a417b3ba06 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:23.735547 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-f36fe307-f7c2-440f-a521-720f7837d922 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:23.757143 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-f36fe307-f7c2-440f-a521-720f7837d922 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:23.759189 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-df2e5f96-d4d9-4114-bba3-c5a417b3ba06 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:23.762702 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-f36fe307-f7c2-440f-a521-720f7837d922 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:23.763930 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-f36fe307-f7c2-440f-a521-720f7837d922 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1281 microversion: 2.20 time: 0.221587 Sep 02 05:23:23.770194 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 15/37] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:23:23 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1281 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:23:23.772937 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-df2e5f96-d4d9-4114-bba3-c5a417b3ba06 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1273 microversion: 2.1 time: 0.204669 Sep 02 05:23:23.778353 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-87285d1a-4d23-47c7-ab50-1eae3a1cb6f0 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:23.779668 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-87285d1a-4d23-47c7-ab50-1eae3a1cb6f0 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:23.788836 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 23/38] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:23 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1273 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:23:23.796425 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-87285d1a-4d23-47c7-ab50-1eae3a1cb6f0 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:23.797393 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-87285d1a-4d23-47c7-ab50-1eae3a1cb6f0 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:23.798198 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-87285d1a-4d23-47c7-ab50-1eae3a1cb6f0 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:23.799219 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-87285d1a-4d23-47c7-ab50-1eae3a1cb6f0 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:23.804723 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-87285d1a-4d23-47c7-ab50-1eae3a1cb6f0 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:23.807797 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-87285d1a-4d23-47c7-ab50-1eae3a1cb6f0 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:23.946975 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-5f304219-2386-4eb9-924d-00a51fc8308c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:23.947916 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-5f304219-2386-4eb9-924d-00a51fc8308c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:23.956035 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5f304219-2386-4eb9-924d-00a51fc8308c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:23.958170 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5f304219-2386-4eb9-924d-00a51fc8308c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:23.958818 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5f304219-2386-4eb9-924d-00a51fc8308c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:23.960617 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5f304219-2386-4eb9-924d-00a51fc8308c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:23.961281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5f304219-2386-4eb9-924d-00a51fc8308c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:23.961934 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5f304219-2386-4eb9-924d-00a51fc8308c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:24.048413 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-87285d1a-4d23-47c7-ab50-1eae3a1cb6f0 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:24.062892 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-87285d1a-4d23-47c7-ab50-1eae3a1cb6f0 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1293 microversion: 2.1 time: 0.291134 Sep 02 05:23:24.067383 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 16/39] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:23 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1293 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:24.089916 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-5f304219-2386-4eb9-924d-00a51fc8308c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:24.100398 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-5f304219-2386-4eb9-924d-00a51fc8308c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1210 microversion: 2.1 time: 0.157111 Sep 02 05:23:24.101689 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 24/40] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:23 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1210 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:23:24.789015 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-7e3ef16c-c1ab-44d4-be9c-b5d6b6617386 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:24.789626 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-7e3ef16c-c1ab-44d4-be9c-b5d6b6617386 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:24.798482 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-a56bbd55-69a3-4c23-90b5-85c283ab6642 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:24.799761 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-a56bbd55-69a3-4c23-90b5-85c283ab6642 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:24.802961 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7e3ef16c-c1ab-44d4-be9c-b5d6b6617386 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:24.803995 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7e3ef16c-c1ab-44d4-be9c-b5d6b6617386 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:24.809603 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a56bbd55-69a3-4c23-90b5-85c283ab6642 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:24.811458 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a56bbd55-69a3-4c23-90b5-85c283ab6642 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:24.815848 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7e3ef16c-c1ab-44d4-be9c-b5d6b6617386 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:24.817357 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a56bbd55-69a3-4c23-90b5-85c283ab6642 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:24.818508 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7e3ef16c-c1ab-44d4-be9c-b5d6b6617386 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:24.819023 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7e3ef16c-c1ab-44d4-be9c-b5d6b6617386 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:24.819475 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7e3ef16c-c1ab-44d4-be9c-b5d6b6617386 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:24.820638 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a56bbd55-69a3-4c23-90b5-85c283ab6642 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:24.822932 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a56bbd55-69a3-4c23-90b5-85c283ab6642 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:24.823982 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a56bbd55-69a3-4c23-90b5-85c283ab6642 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:24.955676 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-7e3ef16c-c1ab-44d4-be9c-b5d6b6617386 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:24.966006 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-7e3ef16c-c1ab-44d4-be9c-b5d6b6617386 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:24.967458 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-7e3ef16c-c1ab-44d4-be9c-b5d6b6617386 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:24.968648 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-7e3ef16c-c1ab-44d4-be9c-b5d6b6617386 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1285 microversion: 2.20 time: 0.183874 Sep 02 05:23:24.969204 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 17/41] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:23:24 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1285 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:23:24.982263 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-08c6bf75-ebf5-445d-a73a-fba4d24a9537 tempest-VolumesTestJSON-1314767656 tempest-VolumesTestJSON-1314767656-project] Calling method '.version_select at 0x7fc90b82ba60>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:25.108067 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-a56bbd55-69a3-4c23-90b5-85c283ab6642 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:25.122577 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-a56bbd55-69a3-4c23-90b5-85c283ab6642 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1273 microversion: 2.1 time: 0.328731 Sep 02 05:23:25.142184 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 25/42] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:24 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1273 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:23:25.148069 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-3232ddf6-d924-4730-b6e6-b3fa04259849 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:25.148795 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-3232ddf6-d924-4730-b6e6-b3fa04259849 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:25.154585 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:25.159578 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3232ddf6-d924-4730-b6e6-b3fa04259849 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:25.160295 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3232ddf6-d924-4730-b6e6-b3fa04259849 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:25.161083 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3232ddf6-d924-4730-b6e6-b3fa04259849 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:25.162222 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3232ddf6-d924-4730-b6e6-b3fa04259849 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:25.162823 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3232ddf6-d924-4730-b6e6-b3fa04259849 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:25.163346 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3232ddf6-d924-4730-b6e6-b3fa04259849 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:25.289547 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-08c6bf75-ebf5-445d-a73a-fba4d24a9537 tempest-VolumesTestJSON-1314767656 tempest-VolumesTestJSON-1314767656-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/bcc3b854-52b1-42a7-a1e6-c125277b30e8" status: 200 len: 350 microversion: 2.1 time: 0.312158 Sep 02 05:23:25.290345 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 18/43] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Sep 2 05:23:24 2022] GET /compute/v2.1/os-volumes/bcc3b854-52b1-42a7-a1e6-c125277b30e8 => generated 350 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:23:25.296972 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5a4bcdac-cf40-48ba-9741-db50a8a21ba9 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:25.297811 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5a4bcdac-cf40-48ba-9741-db50a8a21ba9 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:25.325466 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5a4bcdac-cf40-48ba-9741-db50a8a21ba9 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:25.326088 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5a4bcdac-cf40-48ba-9741-db50a8a21ba9 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:25.326607 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5a4bcdac-cf40-48ba-9741-db50a8a21ba9 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:25.327383 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5a4bcdac-cf40-48ba-9741-db50a8a21ba9 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:25.327920 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5a4bcdac-cf40-48ba-9741-db50a8a21ba9 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:25.347645 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5a4bcdac-cf40-48ba-9741-db50a8a21ba9 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:25.470935 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-3232ddf6-d924-4730-b6e6-b3fa04259849 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:25.491046 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-3232ddf6-d924-4730-b6e6-b3fa04259849 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1299 microversion: 2.1 time: 0.346444 Sep 02 05:23:25.513087 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 26/44] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:25 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1299 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:25.520654 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-9b0934b9-013b-41c2-b032-877ce75259b6 tempest-VolumesTestJSON-1314767656 tempest-VolumesTestJSON-1314767656-project] Calling method '.version_select at 0x7fc90b75f700>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:25.570581 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5a4bcdac-cf40-48ba-9741-db50a8a21ba9 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:25.584056 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5a4bcdac-cf40-48ba-9741-db50a8a21ba9 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1266 microversion: 2.1 time: 0.292502 Sep 02 05:23:25.584822 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 19/45] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:25 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1266 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:25.688261 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-9b0934b9-013b-41c2-b032-877ce75259b6 tempest-VolumesTestJSON-1314767656 tempest-VolumesTestJSON-1314767656-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.173723 Sep 02 05:23:25.689996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 27/46] 10.222.0.30 () {58 vars in 1134 bytes} [Fri Sep 2 05:23:25 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:25.705096 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-1dc01765-cb3f-43c4-99e1-e8b936a7b915 tempest-VolumesTestJSON-1314767656 tempest-VolumesTestJSON-1314767656-project] Calling method '.version_select at 0x7fc90b750a60>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:26.007811 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d958c0fe-1172-4e6c-b8ca-f136165420d1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:26.022225 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-d958c0fe-1172-4e6c-b8ca-f136165420d1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:26.041419 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d958c0fe-1172-4e6c-b8ca-f136165420d1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:26.049225 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d958c0fe-1172-4e6c-b8ca-f136165420d1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:26.051565 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d958c0fe-1172-4e6c-b8ca-f136165420d1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:26.052596 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d958c0fe-1172-4e6c-b8ca-f136165420d1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:26.053460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d958c0fe-1172-4e6c-b8ca-f136165420d1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:26.055459 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d958c0fe-1172-4e6c-b8ca-f136165420d1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:26.181025 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-1dc01765-cb3f-43c4-99e1-e8b936a7b915 tempest-VolumesTestJSON-1314767656 tempest-VolumesTestJSON-1314767656-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.480358 Sep 02 05:23:26.185490 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 20/47] 10.222.0.30 () {58 vars in 1149 bytes} [Fri Sep 2 05:23:25 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:23:26.206566 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-8572e561-762f-4d16-bf10-fd889793ae39 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:26.207306 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-8572e561-762f-4d16-bf10-fd889793ae39 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:26.255266 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8572e561-762f-4d16-bf10-fd889793ae39 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:26.255802 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8572e561-762f-4d16-bf10-fd889793ae39 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:26.278142 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8572e561-762f-4d16-bf10-fd889793ae39 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:26.280101 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8572e561-762f-4d16-bf10-fd889793ae39 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:26.282451 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8572e561-762f-4d16-bf10-fd889793ae39 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:26.287669 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8572e561-762f-4d16-bf10-fd889793ae39 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:26.380910 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d958c0fe-1172-4e6c-b8ca-f136165420d1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:26.403435 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d958c0fe-1172-4e6c-b8ca-f136165420d1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:26.414635 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d958c0fe-1172-4e6c-b8ca-f136165420d1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:26.420476 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-d958c0fe-1172-4e6c-b8ca-f136165420d1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1333 microversion: 2.20 time: 0.419883 Sep 02 05:23:26.421065 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 28/48] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:23:25 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1333 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:23:26.454218 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-e049c211-275c-4e94-9d36-b39d96472297 tempest-VolumesTestJSON-1314767656 tempest-VolumesTestJSON-1314767656-project] Calling method '.version_select at 0x7fc90b75ff70>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:26.622354 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-8572e561-762f-4d16-bf10-fd889793ae39 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:26.637722 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-8572e561-762f-4d16-bf10-fd889793ae39 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1291 microversion: 2.1 time: 0.450474 Sep 02 05:23:26.642836 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 21/49] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:26 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1291 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:26.659314 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-7693b352-a798-42f2-970c-9bde2c1e2e76 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:26.664544 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-7693b352-a798-42f2-970c-9bde2c1e2e76 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:26.692868 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7693b352-a798-42f2-970c-9bde2c1e2e76 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:26.697178 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7693b352-a798-42f2-970c-9bde2c1e2e76 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:26.699480 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7693b352-a798-42f2-970c-9bde2c1e2e76 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:26.701059 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7693b352-a798-42f2-970c-9bde2c1e2e76 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:26.704520 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7693b352-a798-42f2-970c-9bde2c1e2e76 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:26.707159 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7693b352-a798-42f2-970c-9bde2c1e2e76 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:27.000887 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-e049c211-275c-4e94-9d36-b39d96472297 tempest-VolumesTestJSON-1314767656 tempest-VolumesTestJSON-1314767656-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.556712 Sep 02 05:23:27.001541 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 29/50] 10.222.0.30 () {58 vars in 1134 bytes} [Fri Sep 2 05:23:26 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:27.017676 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-98a5594c-9a0d-47c1-993d-ee6cab9501f6 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:27.019055 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-98a5594c-9a0d-47c1-993d-ee6cab9501f6 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:27.044202 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-98a5594c-9a0d-47c1-993d-ee6cab9501f6 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:27.048287 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-98a5594c-9a0d-47c1-993d-ee6cab9501f6 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:27.049011 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-98a5594c-9a0d-47c1-993d-ee6cab9501f6 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:27.051162 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-98a5594c-9a0d-47c1-993d-ee6cab9501f6 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:27.055223 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-98a5594c-9a0d-47c1-993d-ee6cab9501f6 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:27.057146 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-98a5594c-9a0d-47c1-993d-ee6cab9501f6 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:27.608827 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-7693b352-a798-42f2-970c-9bde2c1e2e76 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:27.623727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-7693b352-a798-42f2-970c-9bde2c1e2e76 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1299 microversion: 2.1 time: 0.978940 Sep 02 05:23:27.624651 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 22/51] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:26 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1299 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:27.640190 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-4935d772-5152-4d29-95c3-e4e6eef73960 tempest-VolumesTestJSON-1314767656 tempest-VolumesTestJSON-1314767656-project] Calling method '.version_select at 0x7fc90b7a58b0>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:27.661580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-98a5594c-9a0d-47c1-993d-ee6cab9501f6 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:27.674661 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-98a5594c-9a0d-47c1-993d-ee6cab9501f6 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1274 microversion: 2.1 time: 0.662755 Sep 02 05:23:27.675569 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 30/52] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:27 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1274 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:27.689422 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-be2f1ae6-34a4-464a-990d-edaa0d36a87c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:27.690040 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-be2f1ae6-34a4-464a-990d-edaa0d36a87c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:27.702577 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-be2f1ae6-34a4-464a-990d-edaa0d36a87c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:27.703073 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-be2f1ae6-34a4-464a-990d-edaa0d36a87c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:27.705537 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-be2f1ae6-34a4-464a-990d-edaa0d36a87c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:27.706293 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-be2f1ae6-34a4-464a-990d-edaa0d36a87c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:27.706766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-be2f1ae6-34a4-464a-990d-edaa0d36a87c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:27.707192 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-be2f1ae6-34a4-464a-990d-edaa0d36a87c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:27.838529 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-4935d772-5152-4d29-95c3-e4e6eef73960 tempest-VolumesTestJSON-1314767656 tempest-VolumesTestJSON-1314767656-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.212652 Sep 02 05:23:27.839373 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 23/53] 10.222.0.30 () {58 vars in 1167 bytes} [Fri Sep 2 05:23:27 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:23:27.851650 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-193fe77b-3162-42f5-a458-8d4b067b97e5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:27.852313 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-193fe77b-3162-42f5-a458-8d4b067b97e5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:27.859253 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-193fe77b-3162-42f5-a458-8d4b067b97e5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:27.859743 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-193fe77b-3162-42f5-a458-8d4b067b97e5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:27.864268 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-193fe77b-3162-42f5-a458-8d4b067b97e5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:27.865357 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-193fe77b-3162-42f5-a458-8d4b067b97e5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:27.865846 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-193fe77b-3162-42f5-a458-8d4b067b97e5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:27.866284 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-193fe77b-3162-42f5-a458-8d4b067b97e5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:27.871117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-be2f1ae6-34a4-464a-990d-edaa0d36a87c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:27.883021 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-be2f1ae6-34a4-464a-990d-edaa0d36a87c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:27.884650 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-be2f1ae6-34a4-464a-990d-edaa0d36a87c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:27.885753 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-be2f1ae6-34a4-464a-990d-edaa0d36a87c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1351 microversion: 2.20 time: 0.209159 Sep 02 05:23:27.898864 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 31/54] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:23:27 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1351 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:23:27.898864 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-9dea4dcd-14ef-432e-979d-e7c8ea3b1e19 tempest-VolumesTestJSON-1314767656 tempest-VolumesTestJSON-1314767656-project] Calling method '.version_select at 0x7fc90b75fe50>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:27.968043 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-193fe77b-3162-42f5-a458-8d4b067b97e5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:27.978489 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-193fe77b-3162-42f5-a458-8d4b067b97e5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1279 microversion: 2.1 time: 0.137820 Sep 02 05:23:27.992836 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 24/55] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:27 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1279 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:28.003844 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-9dea4dcd-14ef-432e-979d-e7c8ea3b1e19 tempest-VolumesTestJSON-1314767656 tempest-VolumesTestJSON-1314767656-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.116515 Sep 02 05:23:28.012771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 32/56] 10.222.0.30 () {58 vars in 1170 bytes} [Fri Sep 2 05:23:27 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:23:28.019359 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-7d6204a5-8cda-41b2-a593-61ac2f3c1d0f tempest-VolumesTestJSON-1314767656 tempest-VolumesTestJSON-1314767656-project] Calling method '.version_select at 0x7fc90b7a5c10>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:28.169255 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-7d6204a5-8cda-41b2-a593-61ac2f3c1d0f tempest-VolumesTestJSON-1314767656 tempest-VolumesTestJSON-1314767656-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.153499 Sep 02 05:23:28.170216 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 25/57] 10.222.0.30 () {58 vars in 1155 bytes} [Fri Sep 2 05:23:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:28.204359 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-9f6e80af-d4f8-471b-bc92-788b40201881 tempest-VolumesTestJSON-1314767656 tempest-VolumesTestJSON-1314767656-project] Calling method '.version_select at 0x7fc90b6cf430>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:28.381321 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-9f6e80af-d4f8-471b-bc92-788b40201881 tempest-VolumesTestJSON-1314767656 tempest-VolumesTestJSON-1314767656-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.200722 Sep 02 05:23:28.382713 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 33/58] 10.222.0.30 () {58 vars in 1188 bytes} [Fri Sep 2 05:23:28 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:23:28.403546 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-43b0df45-ca16-44a0-9452-b50b2745e411 tempest-VolumesTestJSON-1314767656 tempest-VolumesTestJSON-1314767656-project] Calling method '.version_select at 0x7fc90b799670>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:28.556039 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-43b0df45-ca16-44a0-9452-b50b2745e411 tempest-VolumesTestJSON-1314767656 tempest-VolumesTestJSON-1314767656-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.162602 Sep 02 05:23:28.556655 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 26/59] 10.222.0.30 () {58 vars in 1155 bytes} [Fri Sep 2 05:23:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:28.647498 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d0033797-da89-4b24-9c88-f865d06df95d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:28.654172 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-d0033797-da89-4b24-9c88-f865d06df95d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:28.671333 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d0033797-da89-4b24-9c88-f865d06df95d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:28.672005 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d0033797-da89-4b24-9c88-f865d06df95d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:28.672489 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d0033797-da89-4b24-9c88-f865d06df95d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:28.673251 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d0033797-da89-4b24-9c88-f865d06df95d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:28.673695 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d0033797-da89-4b24-9c88-f865d06df95d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:28.674124 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d0033797-da89-4b24-9c88-f865d06df95d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:28.706531 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-d58fe12b-27c5-490d-8167-fbdbfbab1f7d tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:28.707154 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-d58fe12b-27c5-490d-8167-fbdbfbab1f7d tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:28.729949 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d58fe12b-27c5-490d-8167-fbdbfbab1f7d tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:28.730465 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d58fe12b-27c5-490d-8167-fbdbfbab1f7d tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:28.732320 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d58fe12b-27c5-490d-8167-fbdbfbab1f7d tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:28.737715 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d58fe12b-27c5-490d-8167-fbdbfbab1f7d tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:28.739692 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d58fe12b-27c5-490d-8167-fbdbfbab1f7d tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:28.740325 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d58fe12b-27c5-490d-8167-fbdbfbab1f7d tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:29.000134 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-d58fe12b-27c5-490d-8167-fbdbfbab1f7d tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:29.014525 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-d58fe12b-27c5-490d-8167-fbdbfbab1f7d tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1284 microversion: 2.1 time: 0.318226 Sep 02 05:23:29.015014 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 27/60] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:28 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1284 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:29.027725 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-1fa663d6-9698-4cc5-bad8-a65babe0d90d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:29.028489 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-1fa663d6-9698-4cc5-bad8-a65babe0d90d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:29.051947 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1fa663d6-9698-4cc5-bad8-a65babe0d90d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:29.052500 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1fa663d6-9698-4cc5-bad8-a65babe0d90d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:29.052937 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1fa663d6-9698-4cc5-bad8-a65babe0d90d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:29.053647 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1fa663d6-9698-4cc5-bad8-a65babe0d90d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:29.054096 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1fa663d6-9698-4cc5-bad8-a65babe0d90d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:29.054516 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1fa663d6-9698-4cc5-bad8-a65babe0d90d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:29.146505 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d0033797-da89-4b24-9c88-f865d06df95d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:29.155837 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-d0033797-da89-4b24-9c88-f865d06df95d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.512463 Sep 02 05:23:29.156842 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 34/61] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:28 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:29.161049 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1fa663d6-9698-4cc5-bad8-a65babe0d90d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:29.169833 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1fa663d6-9698-4cc5-bad8-a65babe0d90d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:29.171463 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1fa663d6-9698-4cc5-bad8-a65babe0d90d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:29.174475 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-1fa663d6-9698-4cc5-bad8-a65babe0d90d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1351 microversion: 2.20 time: 0.153839 Sep 02 05:23:29.175102 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 28/62] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:23:29 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1351 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:23:29.180525 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-a823e0b0-cb1a-48df-a92a-bb24f7392e3b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:29.181456 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-a823e0b0-cb1a-48df-a92a-bb24f7392e3b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:29.188060 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a823e0b0-cb1a-48df-a92a-bb24f7392e3b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:29.188595 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a823e0b0-cb1a-48df-a92a-bb24f7392e3b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:29.189024 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a823e0b0-cb1a-48df-a92a-bb24f7392e3b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:29.189721 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a823e0b0-cb1a-48df-a92a-bb24f7392e3b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:29.190170 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a823e0b0-cb1a-48df-a92a-bb24f7392e3b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:29.190583 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a823e0b0-cb1a-48df-a92a-bb24f7392e3b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:29.246455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-815aec1c-3151-4e6e-811d-995012d0534a req-74db734d-1eaf-4425-bd00-fa1b18c64db4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67493ca3-e212-45fa-886f-5c2bc5239f0b", "tag": "0744525a-63a3-4a71-a8c1-440cbf4eccd2"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:23:29.266652 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-815aec1c-3151-4e6e-811d-995012d0534a req-74db734d-1eaf-4425-bd00-fa1b18c64db4 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:29.267017 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-815aec1c-3151-4e6e-811d-995012d0534a req-74db734d-1eaf-4425-bd00-fa1b18c64db4 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:29.267443 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-815aec1c-3151-4e6e-811d-995012d0534a req-74db734d-1eaf-4425-bd00-fa1b18c64db4 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:29.287056 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-815aec1c-3151-4e6e-811d-995012d0534a req-74db734d-1eaf-4425-bd00-fa1b18c64db4 service nova] Creating event network-changed:0744525a-63a3-4a71-a8c1-440cbf4eccd2 for instance 67493ca3-e212-45fa-886f-5c2bc5239f0b on hv-cinder-85391 Sep 02 05:23:29.287906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-815aec1c-3151-4e6e-811d-995012d0534a req-74db734d-1eaf-4425-bd00-fa1b18c64db4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120448) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 02 05:23:29.288329 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-815aec1c-3151-4e6e-811d-995012d0534a req-74db734d-1eaf-4425-bd00-fa1b18c64db4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120448) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 02 05:23:29.289346 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6f966a40-fd10-4aad-90e8-810fade22c32 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:29.289802 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6f966a40-fd10-4aad-90e8-810fade22c32 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:29.290222 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6f966a40-fd10-4aad-90e8-810fade22c32 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:29.290925 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6f966a40-fd10-4aad-90e8-810fade22c32 None None] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:29.291527 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6f966a40-fd10-4aad-90e8-810fade22c32 None None] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:29.291971 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6f966a40-fd10-4aad-90e8-810fade22c32 None None] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:29.300955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.compute.rpcapi [None req-6f966a40-fd10-4aad-90e8-810fade22c32 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 02 05:23:29.301848 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6f966a40-fd10-4aad-90e8-810fade22c32 None None] Releasing lock "compute-rpcapi-router" {{(pid=120448) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 02 05:23:29.323268 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-6f966a40-fd10-4aad-90e8-810fade22c32 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165092 Sep 02 05:23:29.323873 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 35/63] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:23:29.359438 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-a823e0b0-cb1a-48df-a92a-bb24f7392e3b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:29.367206 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-a823e0b0-cb1a-48df-a92a-bb24f7392e3b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.191081 Sep 02 05:23:29.367685 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 29/64] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:29 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:30.035893 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-8e85167a-861d-4219-95ab-c1094bc0252c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:30.037418 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-8e85167a-861d-4219-95ab-c1094bc0252c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:30.044350 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8e85167a-861d-4219-95ab-c1094bc0252c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:30.044829 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8e85167a-861d-4219-95ab-c1094bc0252c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:30.045256 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8e85167a-861d-4219-95ab-c1094bc0252c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:30.045940 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8e85167a-861d-4219-95ab-c1094bc0252c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:30.046386 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8e85167a-861d-4219-95ab-c1094bc0252c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:30.046798 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8e85167a-861d-4219-95ab-c1094bc0252c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:30.112192 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-8e85167a-861d-4219-95ab-c1094bc0252c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:30.120484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-8e85167a-861d-4219-95ab-c1094bc0252c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1284 microversion: 2.1 time: 0.089040 Sep 02 05:23:30.121305 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 36/65] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:30 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:30.180406 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-24662832-95b9-419a-868b-929dd12bf1e9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:30.180937 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-24662832-95b9-419a-868b-929dd12bf1e9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:30.189061 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-24662832-95b9-419a-868b-929dd12bf1e9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:30.189542 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-24662832-95b9-419a-868b-929dd12bf1e9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:30.189972 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-24662832-95b9-419a-868b-929dd12bf1e9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:30.190656 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-24662832-95b9-419a-868b-929dd12bf1e9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:30.191110 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-24662832-95b9-419a-868b-929dd12bf1e9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:30.191531 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-24662832-95b9-419a-868b-929dd12bf1e9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:30.200608 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-7554c2a8-2c49-4a24-b280-c9b0b7d8c3d0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:30.201522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-7554c2a8-2c49-4a24-b280-c9b0b7d8c3d0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:30.208015 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7554c2a8-2c49-4a24-b280-c9b0b7d8c3d0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:30.208544 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7554c2a8-2c49-4a24-b280-c9b0b7d8c3d0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:30.208973 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7554c2a8-2c49-4a24-b280-c9b0b7d8c3d0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:30.209650 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7554c2a8-2c49-4a24-b280-c9b0b7d8c3d0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:30.210094 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7554c2a8-2c49-4a24-b280-c9b0b7d8c3d0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:30.210522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7554c2a8-2c49-4a24-b280-c9b0b7d8c3d0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:30.212312 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell0:SELECT=6 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:30.214896 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=100 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:30.288894 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-7554c2a8-2c49-4a24-b280-c9b0b7d8c3d0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:30.297346 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-7554c2a8-2c49-4a24-b280-c9b0b7d8c3d0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:30.298777 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-7554c2a8-2c49-4a24-b280-c9b0b7d8c3d0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:30.299882 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-7554c2a8-2c49-4a24-b280-c9b0b7d8c3d0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1351 microversion: 2.20 time: 0.103185 Sep 02 05:23:30.300477 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 37/66] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:23:30 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:23:30.348101 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-24662832-95b9-419a-868b-929dd12bf1e9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:30.355816 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-24662832-95b9-419a-868b-929dd12bf1e9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.181318 Sep 02 05:23:30.356468 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 30/67] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:30 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:30.388344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f959b843-6a26-4909-8396-799bdf171172 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:30.388958 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f959b843-6a26-4909-8396-799bdf171172 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:30.395499 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f959b843-6a26-4909-8396-799bdf171172 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:30.395987 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f959b843-6a26-4909-8396-799bdf171172 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:30.396458 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f959b843-6a26-4909-8396-799bdf171172 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:30.397142 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f959b843-6a26-4909-8396-799bdf171172 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:30.397599 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f959b843-6a26-4909-8396-799bdf171172 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:30.398026 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f959b843-6a26-4909-8396-799bdf171172 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:30.537388 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f959b843-6a26-4909-8396-799bdf171172 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:30.545453 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f959b843-6a26-4909-8396-799bdf171172 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.161114 Sep 02 05:23:30.546019 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 38/68] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:30 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:31.141354 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-4badb345-d87e-411a-82bf-1f1a01401fae tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:31.141953 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-4badb345-d87e-411a-82bf-1f1a01401fae tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:31.148348 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4badb345-d87e-411a-82bf-1f1a01401fae tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:31.148822 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4badb345-d87e-411a-82bf-1f1a01401fae tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:31.149242 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4badb345-d87e-411a-82bf-1f1a01401fae tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:31.149920 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4badb345-d87e-411a-82bf-1f1a01401fae tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:31.150363 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4badb345-d87e-411a-82bf-1f1a01401fae tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:31.150760 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4badb345-d87e-411a-82bf-1f1a01401fae tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:31.221255 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-4badb345-d87e-411a-82bf-1f1a01401fae tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:31.229222 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-4badb345-d87e-411a-82bf-1f1a01401fae tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1284 microversion: 2.1 time: 0.091725 Sep 02 05:23:31.229941 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 31/69] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:31 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:31.322311 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-c1f939f3-9e4c-4f3e-be36-b14aee2362da tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:31.322937 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-c1f939f3-9e4c-4f3e-be36-b14aee2362da tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:31.330480 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c1f939f3-9e4c-4f3e-be36-b14aee2362da tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:31.330892 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c1f939f3-9e4c-4f3e-be36-b14aee2362da tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:31.331316 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c1f939f3-9e4c-4f3e-be36-b14aee2362da tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:31.331995 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c1f939f3-9e4c-4f3e-be36-b14aee2362da tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:31.332461 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c1f939f3-9e4c-4f3e-be36-b14aee2362da tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:31.332877 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c1f939f3-9e4c-4f3e-be36-b14aee2362da tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:31.377737 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-7f48c044-2b5f-442f-9f3f-f1374deaedd9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:31.378529 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-7f48c044-2b5f-442f-9f3f-f1374deaedd9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:31.385373 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7f48c044-2b5f-442f-9f3f-f1374deaedd9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:31.385859 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7f48c044-2b5f-442f-9f3f-f1374deaedd9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:31.386286 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7f48c044-2b5f-442f-9f3f-f1374deaedd9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:31.387014 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7f48c044-2b5f-442f-9f3f-f1374deaedd9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:31.387490 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7f48c044-2b5f-442f-9f3f-f1374deaedd9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:31.387915 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7f48c044-2b5f-442f-9f3f-f1374deaedd9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:31.396739 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c1f939f3-9e4c-4f3e-be36-b14aee2362da tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:31.404771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c1f939f3-9e4c-4f3e-be36-b14aee2362da tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:31.406391 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c1f939f3-9e4c-4f3e-be36-b14aee2362da tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:31.407157 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=100 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:31.407886 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-c1f939f3-9e4c-4f3e-be36-b14aee2362da tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1351 microversion: 2.20 time: 0.089195 Sep 02 05:23:31.408795 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 39/70] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:23:31 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1351 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:23:31.559932 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-7f48c044-2b5f-442f-9f3f-f1374deaedd9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:31.571301 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-03592552-97a3-46b5-9ab6-02196ba63a1a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:31.572301 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-03592552-97a3-46b5-9ab6-02196ba63a1a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:31.578442 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-7f48c044-2b5f-442f-9f3f-f1374deaedd9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.205079 Sep 02 05:23:31.591653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 32/71] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:31 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:23:31.593565 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-03592552-97a3-46b5-9ab6-02196ba63a1a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:31.594060 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-03592552-97a3-46b5-9ab6-02196ba63a1a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:31.594494 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-03592552-97a3-46b5-9ab6-02196ba63a1a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:31.595200 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-03592552-97a3-46b5-9ab6-02196ba63a1a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:31.595656 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-03592552-97a3-46b5-9ab6-02196ba63a1a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:31.596074 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-03592552-97a3-46b5-9ab6-02196ba63a1a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:31.749938 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-03592552-97a3-46b5-9ab6-02196ba63a1a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:31.757667 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-03592552-97a3-46b5-9ab6-02196ba63a1a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.195628 Sep 02 05:23:31.758229 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 40/72] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:31 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:32.250532 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-10d714b3-3a22-4241-a71a-172cea4d6813 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:32.251724 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-10d714b3-3a22-4241-a71a-172cea4d6813 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:32.258387 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-10d714b3-3a22-4241-a71a-172cea4d6813 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:32.258941 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-10d714b3-3a22-4241-a71a-172cea4d6813 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:32.259367 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-10d714b3-3a22-4241-a71a-172cea4d6813 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:32.260057 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-10d714b3-3a22-4241-a71a-172cea4d6813 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:32.260547 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-10d714b3-3a22-4241-a71a-172cea4d6813 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:32.260965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-10d714b3-3a22-4241-a71a-172cea4d6813 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:32.375943 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-10d714b3-3a22-4241-a71a-172cea4d6813 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:32.398130 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-10d714b3-3a22-4241-a71a-172cea4d6813 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1284 microversion: 2.1 time: 0.151444 Sep 02 05:23:32.400638 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 33/73] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:32 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1284 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:32.431578 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f9fee5be-f6e5-4f40-a43a-3833cc4ccb59 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:32.432310 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f9fee5be-f6e5-4f40-a43a-3833cc4ccb59 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:32.438950 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f9fee5be-f6e5-4f40-a43a-3833cc4ccb59 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:32.439462 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f9fee5be-f6e5-4f40-a43a-3833cc4ccb59 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:32.439987 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f9fee5be-f6e5-4f40-a43a-3833cc4ccb59 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:32.440636 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f9fee5be-f6e5-4f40-a43a-3833cc4ccb59 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:32.441120 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f9fee5be-f6e5-4f40-a43a-3833cc4ccb59 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:32.443363 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f9fee5be-f6e5-4f40-a43a-3833cc4ccb59 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:32.534724 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f9fee5be-f6e5-4f40-a43a-3833cc4ccb59 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:32.560965 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f9fee5be-f6e5-4f40-a43a-3833cc4ccb59 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:32.562892 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f9fee5be-f6e5-4f40-a43a-3833cc4ccb59 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:32.564253 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f9fee5be-f6e5-4f40-a43a-3833cc4ccb59 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1351 microversion: 2.20 time: 0.136878 Sep 02 05:23:32.565362 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 41/74] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:23:32 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1351 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:23:32.600546 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-56154ede-d09a-44b7-ac40-aabbc87ec234 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:32.601645 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-56154ede-d09a-44b7-ac40-aabbc87ec234 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:32.609873 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-56154ede-d09a-44b7-ac40-aabbc87ec234 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:32.615177 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-56154ede-d09a-44b7-ac40-aabbc87ec234 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:32.616062 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-56154ede-d09a-44b7-ac40-aabbc87ec234 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:32.617078 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-56154ede-d09a-44b7-ac40-aabbc87ec234 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:32.617878 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-56154ede-d09a-44b7-ac40-aabbc87ec234 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:32.618562 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-56154ede-d09a-44b7-ac40-aabbc87ec234 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:32.778681 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-37cc13d3-44f3-4dd6-acb4-a82b6c51f6dd tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:32.779447 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-37cc13d3-44f3-4dd6-acb4-a82b6c51f6dd tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:32.796498 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-37cc13d3-44f3-4dd6-acb4-a82b6c51f6dd tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:32.798345 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-37cc13d3-44f3-4dd6-acb4-a82b6c51f6dd tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:32.799076 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-37cc13d3-44f3-4dd6-acb4-a82b6c51f6dd tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:32.799679 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-56154ede-d09a-44b7-ac40-aabbc87ec234 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:32.802232 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-37cc13d3-44f3-4dd6-acb4-a82b6c51f6dd tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:32.803044 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-37cc13d3-44f3-4dd6-acb4-a82b6c51f6dd tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:32.804832 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-37cc13d3-44f3-4dd6-acb4-a82b6c51f6dd tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:32.808574 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-56154ede-d09a-44b7-ac40-aabbc87ec234 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.211769 Sep 02 05:23:32.809269 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 34/75] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:32 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:33.013607 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-37cc13d3-44f3-4dd6-acb4-a82b6c51f6dd tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:33.023507 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-37cc13d3-44f3-4dd6-acb4-a82b6c51f6dd tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.248541 Sep 02 05:23:33.024497 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 42/76] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:32 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:33.425735 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-036b0ed4-9a61-4e7b-b842-4be56331460e tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:33.426561 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-036b0ed4-9a61-4e7b-b842-4be56331460e tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:33.439352 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-036b0ed4-9a61-4e7b-b842-4be56331460e tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:33.441841 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-036b0ed4-9a61-4e7b-b842-4be56331460e tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:33.442997 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-036b0ed4-9a61-4e7b-b842-4be56331460e tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:33.445771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-036b0ed4-9a61-4e7b-b842-4be56331460e tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:33.446338 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-036b0ed4-9a61-4e7b-b842-4be56331460e tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:33.446796 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-036b0ed4-9a61-4e7b-b842-4be56331460e tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:33.523914 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-036b0ed4-9a61-4e7b-b842-4be56331460e tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:33.532470 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-036b0ed4-9a61-4e7b-b842-4be56331460e tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1284 microversion: 2.1 time: 0.110590 Sep 02 05:23:33.533022 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 35/77] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:33 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:33.591369 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-e6292ffc-7575-49e2-b278-1e8110091393 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:33.591969 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-e6292ffc-7575-49e2-b278-1e8110091393 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:33.593907 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell0:SELECT=30 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:33.599639 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e6292ffc-7575-49e2-b278-1e8110091393 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:33.600184 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e6292ffc-7575-49e2-b278-1e8110091393 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:33.600670 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e6292ffc-7575-49e2-b278-1e8110091393 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:33.601387 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e6292ffc-7575-49e2-b278-1e8110091393 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:33.601874 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e6292ffc-7575-49e2-b278-1e8110091393 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:33.602325 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e6292ffc-7575-49e2-b278-1e8110091393 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:33.703892 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-e6292ffc-7575-49e2-b278-1e8110091393 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:33.712447 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-e6292ffc-7575-49e2-b278-1e8110091393 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:33.714095 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-e6292ffc-7575-49e2-b278-1e8110091393 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:33.715225 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-e6292ffc-7575-49e2-b278-1e8110091393 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1351 microversion: 2.20 time: 0.128166 Sep 02 05:23:33.717734 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 43/78] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:23:33 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1351 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:23:33.831134 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-c9a05c43-a22f-4143-bd64-96adc8233968 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:33.832059 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-c9a05c43-a22f-4143-bd64-96adc8233968 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:33.834581 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell0:SELECT=20 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:33.840719 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c9a05c43-a22f-4143-bd64-96adc8233968 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:33.841564 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c9a05c43-a22f-4143-bd64-96adc8233968 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:33.841980 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c9a05c43-a22f-4143-bd64-96adc8233968 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:33.842883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c9a05c43-a22f-4143-bd64-96adc8233968 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:33.843338 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c9a05c43-a22f-4143-bd64-96adc8233968 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:33.843752 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c9a05c43-a22f-4143-bd64-96adc8233968 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:34.045907 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f62bff83-8fb1-49e4-b8d3-d657f7042f2b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:34.047388 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f62bff83-8fb1-49e4-b8d3-d657f7042f2b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:34.060755 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f62bff83-8fb1-49e4-b8d3-d657f7042f2b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:34.061484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f62bff83-8fb1-49e4-b8d3-d657f7042f2b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:34.065747 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f62bff83-8fb1-49e4-b8d3-d657f7042f2b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:34.067227 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f62bff83-8fb1-49e4-b8d3-d657f7042f2b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:34.067731 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f62bff83-8fb1-49e4-b8d3-d657f7042f2b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:34.068192 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f62bff83-8fb1-49e4-b8d3-d657f7042f2b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:34.092349 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-c9a05c43-a22f-4143-bd64-96adc8233968 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:34.127726 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-c9a05c43-a22f-4143-bd64-96adc8233968 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.300828 Sep 02 05:23:34.128338 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 36/79] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:33 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:34.349525 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f62bff83-8fb1-49e4-b8d3-d657f7042f2b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:34.363070 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f62bff83-8fb1-49e4-b8d3-d657f7042f2b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.321450 Sep 02 05:23:34.364605 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 44/80] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:34 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:34.554999 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-0ebb81ea-3c6f-41ba-b290-76bfa313b86c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:34.555653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-0ebb81ea-3c6f-41ba-b290-76bfa313b86c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:34.562057 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0ebb81ea-3c6f-41ba-b290-76bfa313b86c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:34.562547 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0ebb81ea-3c6f-41ba-b290-76bfa313b86c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:34.562982 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0ebb81ea-3c6f-41ba-b290-76bfa313b86c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:34.563687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0ebb81ea-3c6f-41ba-b290-76bfa313b86c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:34.564216 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0ebb81ea-3c6f-41ba-b290-76bfa313b86c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:34.564703 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0ebb81ea-3c6f-41ba-b290-76bfa313b86c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:34.659072 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-0ebb81ea-3c6f-41ba-b290-76bfa313b86c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:34.666811 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-0ebb81ea-3c6f-41ba-b290-76bfa313b86c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1284 microversion: 2.1 time: 0.116007 Sep 02 05:23:34.667370 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 37/81] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:34 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:34.737962 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-a1cb527d-c74e-43d4-8849-cbde9acc64f5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:34.738575 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-a1cb527d-c74e-43d4-8849-cbde9acc64f5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:34.749352 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a1cb527d-c74e-43d4-8849-cbde9acc64f5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:34.749829 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a1cb527d-c74e-43d4-8849-cbde9acc64f5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:34.751050 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a1cb527d-c74e-43d4-8849-cbde9acc64f5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:34.751809 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a1cb527d-c74e-43d4-8849-cbde9acc64f5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:34.752592 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a1cb527d-c74e-43d4-8849-cbde9acc64f5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:34.753055 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a1cb527d-c74e-43d4-8849-cbde9acc64f5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:34.844767 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-a1cb527d-c74e-43d4-8849-cbde9acc64f5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:34.870275 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-a1cb527d-c74e-43d4-8849-cbde9acc64f5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:34.872343 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-a1cb527d-c74e-43d4-8849-cbde9acc64f5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:34.873692 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-a1cb527d-c74e-43d4-8849-cbde9acc64f5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1351 microversion: 2.20 time: 0.139770 Sep 02 05:23:34.888141 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 45/82] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:23:34 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1351 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:23:35.149315 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ec3bac6c-b80c-4609-b965-dfe020bccf60 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:35.149880 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-ec3bac6c-b80c-4609-b965-dfe020bccf60 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:35.167309 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ec3bac6c-b80c-4609-b965-dfe020bccf60 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:35.167980 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ec3bac6c-b80c-4609-b965-dfe020bccf60 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:35.168640 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ec3bac6c-b80c-4609-b965-dfe020bccf60 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:35.169503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ec3bac6c-b80c-4609-b965-dfe020bccf60 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:35.170104 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ec3bac6c-b80c-4609-b965-dfe020bccf60 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:35.170670 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ec3bac6c-b80c-4609-b965-dfe020bccf60 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:35.352318 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ec3bac6c-b80c-4609-b965-dfe020bccf60 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:35.367494 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-ec3bac6c-b80c-4609-b965-dfe020bccf60 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.221394 Sep 02 05:23:35.368710 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 38/83] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:35 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:35.386917 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-def96b39-b7db-4fc9-a86e-4a9ec0a23905 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:35.388370 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-def96b39-b7db-4fc9-a86e-4a9ec0a23905 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:35.394850 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-def96b39-b7db-4fc9-a86e-4a9ec0a23905 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:35.395608 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-def96b39-b7db-4fc9-a86e-4a9ec0a23905 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:35.396275 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-def96b39-b7db-4fc9-a86e-4a9ec0a23905 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:35.397151 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-def96b39-b7db-4fc9-a86e-4a9ec0a23905 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:35.397768 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-def96b39-b7db-4fc9-a86e-4a9ec0a23905 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:35.398624 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-def96b39-b7db-4fc9-a86e-4a9ec0a23905 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:35.565680 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-def96b39-b7db-4fc9-a86e-4a9ec0a23905 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:35.574360 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-def96b39-b7db-4fc9-a86e-4a9ec0a23905 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.191941 Sep 02 05:23:35.574974 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 46/84] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:35 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:35.687340 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-3039bb6a-265b-461e-bd15-8eddc0343c41 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:35.687945 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-3039bb6a-265b-461e-bd15-8eddc0343c41 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:35.689825 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=9 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:35.695374 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3039bb6a-265b-461e-bd15-8eddc0343c41 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:35.695692 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3039bb6a-265b-461e-bd15-8eddc0343c41 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:35.695890 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3039bb6a-265b-461e-bd15-8eddc0343c41 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:35.696794 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3039bb6a-265b-461e-bd15-8eddc0343c41 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:35.697675 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3039bb6a-265b-461e-bd15-8eddc0343c41 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:35.698154 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3039bb6a-265b-461e-bd15-8eddc0343c41 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:35.777187 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-3039bb6a-265b-461e-bd15-8eddc0343c41 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:35.785344 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-3039bb6a-265b-461e-bd15-8eddc0343c41 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1284 microversion: 2.1 time: 0.102088 Sep 02 05:23:35.785946 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 39/85] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:35 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:35.897614 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-1c2c352c-8af9-4361-a700-906b7693d045 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:35.898244 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-1c2c352c-8af9-4361-a700-906b7693d045 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:35.904612 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1c2c352c-8af9-4361-a700-906b7693d045 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:35.905122 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1c2c352c-8af9-4361-a700-906b7693d045 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:35.905579 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1c2c352c-8af9-4361-a700-906b7693d045 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:35.906294 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1c2c352c-8af9-4361-a700-906b7693d045 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:35.906790 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1c2c352c-8af9-4361-a700-906b7693d045 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:35.907371 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1c2c352c-8af9-4361-a700-906b7693d045 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:35.971206 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-1c2c352c-8af9-4361-a700-906b7693d045 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:35.979326 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-1c2c352c-8af9-4361-a700-906b7693d045 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:35.980832 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-1c2c352c-8af9-4361-a700-906b7693d045 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:35.981934 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-1c2c352c-8af9-4361-a700-906b7693d045 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1351 microversion: 2.20 time: 0.088423 Sep 02 05:23:35.982490 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 47/86] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:23:35 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1351 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:23:36.390447 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-94a4845b-48bd-49fc-8d55-bf38962d26bc tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:36.391057 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-94a4845b-48bd-49fc-8d55-bf38962d26bc tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:36.397002 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-94a4845b-48bd-49fc-8d55-bf38962d26bc tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:36.397472 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-94a4845b-48bd-49fc-8d55-bf38962d26bc tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:36.397900 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-94a4845b-48bd-49fc-8d55-bf38962d26bc tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:36.398584 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-94a4845b-48bd-49fc-8d55-bf38962d26bc tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:36.399028 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-94a4845b-48bd-49fc-8d55-bf38962d26bc tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:36.399448 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-94a4845b-48bd-49fc-8d55-bf38962d26bc tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:36.534072 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-94a4845b-48bd-49fc-8d55-bf38962d26bc tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:36.542974 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-94a4845b-48bd-49fc-8d55-bf38962d26bc tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.156263 Sep 02 05:23:36.543673 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 40/87] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:36 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:36.595045 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-5ab4100f-b5dc-467f-be8c-274655d17f0e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:36.595568 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-5ab4100f-b5dc-467f-be8c-274655d17f0e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:36.601480 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5ab4100f-b5dc-467f-be8c-274655d17f0e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:36.601950 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5ab4100f-b5dc-467f-be8c-274655d17f0e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:36.602400 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5ab4100f-b5dc-467f-be8c-274655d17f0e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:36.603070 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5ab4100f-b5dc-467f-be8c-274655d17f0e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:36.603573 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5ab4100f-b5dc-467f-be8c-274655d17f0e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:36.603990 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5ab4100f-b5dc-467f-be8c-274655d17f0e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:36.752085 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-5ab4100f-b5dc-467f-be8c-274655d17f0e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:36.760044 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-5ab4100f-b5dc-467f-be8c-274655d17f0e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.169025 Sep 02 05:23:36.760650 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 48/88] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:36 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:36.806175 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-e00480e5-51c8-437e-83a2-c5c92aaf21bb tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:36.807505 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-e00480e5-51c8-437e-83a2-c5c92aaf21bb tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:36.813573 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e00480e5-51c8-437e-83a2-c5c92aaf21bb tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:36.814050 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e00480e5-51c8-437e-83a2-c5c92aaf21bb tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:36.814478 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e00480e5-51c8-437e-83a2-c5c92aaf21bb tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:36.815209 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e00480e5-51c8-437e-83a2-c5c92aaf21bb tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:36.815691 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e00480e5-51c8-437e-83a2-c5c92aaf21bb tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:36.816144 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e00480e5-51c8-437e-83a2-c5c92aaf21bb tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:36.882599 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e00480e5-51c8-437e-83a2-c5c92aaf21bb tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:36.890567 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-e00480e5-51c8-437e-83a2-c5c92aaf21bb tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1284 microversion: 2.1 time: 0.088669 Sep 02 05:23:36.896160 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 41/89] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:36 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:37.004790 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-12f75d10-1bce-4911-8679-52cfa4ac83e3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:37.005394 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-12f75d10-1bce-4911-8679-52cfa4ac83e3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:37.011327 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-12f75d10-1bce-4911-8679-52cfa4ac83e3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:37.011806 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-12f75d10-1bce-4911-8679-52cfa4ac83e3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:37.012374 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-12f75d10-1bce-4911-8679-52cfa4ac83e3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:37.013096 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-12f75d10-1bce-4911-8679-52cfa4ac83e3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:37.013552 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-12f75d10-1bce-4911-8679-52cfa4ac83e3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:37.013975 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-12f75d10-1bce-4911-8679-52cfa4ac83e3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:37.074686 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-12f75d10-1bce-4911-8679-52cfa4ac83e3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:37.082823 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-12f75d10-1bce-4911-8679-52cfa4ac83e3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:37.084281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-12f75d10-1bce-4911-8679-52cfa4ac83e3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:37.085389 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-12f75d10-1bce-4911-8679-52cfa4ac83e3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1351 microversion: 2.20 time: 0.084507 Sep 02 05:23:37.085941 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 49/90] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:23:36 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1351 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:23:37.575279 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-d2235183-e5e3-4545-af5f-0e71e0a8fa47 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:37.576650 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-d2235183-e5e3-4545-af5f-0e71e0a8fa47 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:37.585308 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d2235183-e5e3-4545-af5f-0e71e0a8fa47 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:37.588701 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d2235183-e5e3-4545-af5f-0e71e0a8fa47 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:37.589615 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d2235183-e5e3-4545-af5f-0e71e0a8fa47 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:37.591014 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d2235183-e5e3-4545-af5f-0e71e0a8fa47 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:37.593706 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d2235183-e5e3-4545-af5f-0e71e0a8fa47 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:37.594398 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d2235183-e5e3-4545-af5f-0e71e0a8fa47 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:37.780145 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-d2235183-e5e3-4545-af5f-0e71e0a8fa47 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:37.783156 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-ba3eaeaa-f5b7-4d37-b013-8a226945c63e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:37.784686 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-ba3eaeaa-f5b7-4d37-b013-8a226945c63e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:37.788915 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-d2235183-e5e3-4545-af5f-0e71e0a8fa47 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.228052 Sep 02 05:23:37.789507 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 42/91] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:37 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:37.792010 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ba3eaeaa-f5b7-4d37-b013-8a226945c63e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:37.792866 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ba3eaeaa-f5b7-4d37-b013-8a226945c63e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:37.793475 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ba3eaeaa-f5b7-4d37-b013-8a226945c63e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:37.794289 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ba3eaeaa-f5b7-4d37-b013-8a226945c63e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:37.794941 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ba3eaeaa-f5b7-4d37-b013-8a226945c63e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:37.795437 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ba3eaeaa-f5b7-4d37-b013-8a226945c63e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:37.910967 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-66840d81-064b-43d7-9bde-4994183f328b tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:37.911509 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-66840d81-064b-43d7-9bde-4994183f328b tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:37.917376 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-66840d81-064b-43d7-9bde-4994183f328b tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:37.917845 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-66840d81-064b-43d7-9bde-4994183f328b tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:37.918402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-66840d81-064b-43d7-9bde-4994183f328b tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:37.919082 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-66840d81-064b-43d7-9bde-4994183f328b tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:37.919522 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-66840d81-064b-43d7-9bde-4994183f328b tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:37.919936 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-66840d81-064b-43d7-9bde-4994183f328b tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:37.937665 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-ba3eaeaa-f5b7-4d37-b013-8a226945c63e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:37.950777 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-ba3eaeaa-f5b7-4d37-b013-8a226945c63e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.171968 Sep 02 05:23:37.951357 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 50/92] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:37 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:37.992328 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-66840d81-064b-43d7-9bde-4994183f328b tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:38.000803 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-66840d81-064b-43d7-9bde-4994183f328b tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1284 microversion: 2.1 time: 0.093763 Sep 02 05:23:38.001367 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 43/93] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:37 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:23:38.108359 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-77718d4e-0677-4d2d-ae30-7dff8a3f6499 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:38.109685 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-77718d4e-0677-4d2d-ae30-7dff8a3f6499 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:38.116186 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-77718d4e-0677-4d2d-ae30-7dff8a3f6499 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:38.116680 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-77718d4e-0677-4d2d-ae30-7dff8a3f6499 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:38.117119 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-77718d4e-0677-4d2d-ae30-7dff8a3f6499 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:38.117879 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-77718d4e-0677-4d2d-ae30-7dff8a3f6499 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:38.118319 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-77718d4e-0677-4d2d-ae30-7dff8a3f6499 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:38.118743 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-77718d4e-0677-4d2d-ae30-7dff8a3f6499 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:38.186200 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-77718d4e-0677-4d2d-ae30-7dff8a3f6499 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:38.195324 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-77718d4e-0677-4d2d-ae30-7dff8a3f6499 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:38.196791 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-77718d4e-0677-4d2d-ae30-7dff8a3f6499 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:38.197899 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-77718d4e-0677-4d2d-ae30-7dff8a3f6499 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1351 microversion: 2.20 time: 0.093504 Sep 02 05:23:38.198460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 51/94] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:23:38 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1351 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:23:38.810119 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-bdca6a6c-1fd1-479a-be36-bf9c5fe7d479 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:38.810713 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-bdca6a6c-1fd1-479a-be36-bf9c5fe7d479 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:38.816612 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bdca6a6c-1fd1-479a-be36-bf9c5fe7d479 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:38.817078 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bdca6a6c-1fd1-479a-be36-bf9c5fe7d479 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:38.817507 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bdca6a6c-1fd1-479a-be36-bf9c5fe7d479 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:38.818168 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bdca6a6c-1fd1-479a-be36-bf9c5fe7d479 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:38.818653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bdca6a6c-1fd1-479a-be36-bf9c5fe7d479 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:38.819092 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bdca6a6c-1fd1-479a-be36-bf9c5fe7d479 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:38.965225 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-bdca6a6c-1fd1-479a-be36-bf9c5fe7d479 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:38.971044 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-445dd6d3-4cc5-4562-8394-e6edd854f875 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:38.971780 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-445dd6d3-4cc5-4562-8394-e6edd854f875 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:38.974723 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-bdca6a6c-1fd1-479a-be36-bf9c5fe7d479 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.168468 Sep 02 05:23:38.975298 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 44/95] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:38 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:38.978931 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-445dd6d3-4cc5-4562-8394-e6edd854f875 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:38.979682 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-445dd6d3-4cc5-4562-8394-e6edd854f875 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:38.980350 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-445dd6d3-4cc5-4562-8394-e6edd854f875 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:38.981828 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-445dd6d3-4cc5-4562-8394-e6edd854f875 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:38.982577 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-445dd6d3-4cc5-4562-8394-e6edd854f875 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:38.983274 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-445dd6d3-4cc5-4562-8394-e6edd854f875 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:39.022338 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-837f017f-a316-43be-8e44-719626a51f77 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:39.023502 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-837f017f-a316-43be-8e44-719626a51f77 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:39.032921 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-837f017f-a316-43be-8e44-719626a51f77 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:39.033746 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-837f017f-a316-43be-8e44-719626a51f77 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:39.034378 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-837f017f-a316-43be-8e44-719626a51f77 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:39.035324 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-837f017f-a316-43be-8e44-719626a51f77 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:39.035974 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-837f017f-a316-43be-8e44-719626a51f77 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:39.036823 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-837f017f-a316-43be-8e44-719626a51f77 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:39.111608 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-837f017f-a316-43be-8e44-719626a51f77 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:39.120062 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-837f017f-a316-43be-8e44-719626a51f77 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1284 microversion: 2.1 time: 0.102427 Sep 02 05:23:39.121212 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 45/96] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:39 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:23:39.149374 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-445dd6d3-4cc5-4562-8394-e6edd854f875 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:39.157134 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-445dd6d3-4cc5-4562-8394-e6edd854f875 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.190001 Sep 02 05:23:39.157692 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 52/97] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:38 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:39.220663 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-0bbef68c-80ec-4797-b941-2832773235a0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:39.221176 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-0bbef68c-80ec-4797-b941-2832773235a0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:39.227418 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0bbef68c-80ec-4797-b941-2832773235a0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:39.228145 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0bbef68c-80ec-4797-b941-2832773235a0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:39.228730 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0bbef68c-80ec-4797-b941-2832773235a0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:39.229435 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0bbef68c-80ec-4797-b941-2832773235a0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:39.229889 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0bbef68c-80ec-4797-b941-2832773235a0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:39.230316 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0bbef68c-80ec-4797-b941-2832773235a0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:39.296739 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-0bbef68c-80ec-4797-b941-2832773235a0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:39.305168 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-0bbef68c-80ec-4797-b941-2832773235a0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:39.306642 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-0bbef68c-80ec-4797-b941-2832773235a0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:39.307739 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-0bbef68c-80ec-4797-b941-2832773235a0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1351 microversion: 2.20 time: 0.091150 Sep 02 05:23:39.308303 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 46/98] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:23:39 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1351 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:23:39.995522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-559a1061-679f-4aea-8956-96129ba490b7 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:39.996135 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-559a1061-679f-4aea-8956-96129ba490b7 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:39.998383 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell0:SELECT=6 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:40.003810 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-559a1061-679f-4aea-8956-96129ba490b7 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:40.004326 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-559a1061-679f-4aea-8956-96129ba490b7 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:40.004760 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-559a1061-679f-4aea-8956-96129ba490b7 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:40.005412 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-559a1061-679f-4aea-8956-96129ba490b7 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:40.005868 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-559a1061-679f-4aea-8956-96129ba490b7 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:40.006281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-559a1061-679f-4aea-8956-96129ba490b7 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:40.141448 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-26107aa3-3da9-4771-a13c-482a55247f55 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:40.142164 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-26107aa3-3da9-4771-a13c-482a55247f55 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:40.148231 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-26107aa3-3da9-4771-a13c-482a55247f55 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:40.148722 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-26107aa3-3da9-4771-a13c-482a55247f55 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:40.149215 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-26107aa3-3da9-4771-a13c-482a55247f55 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:40.149831 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-26107aa3-3da9-4771-a13c-482a55247f55 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:40.150273 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-26107aa3-3da9-4771-a13c-482a55247f55 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:40.150693 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-26107aa3-3da9-4771-a13c-482a55247f55 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:40.155362 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-559a1061-679f-4aea-8956-96129ba490b7 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:40.158818 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=100 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:40.164176 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-559a1061-679f-4aea-8956-96129ba490b7 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.172961 Sep 02 05:23:40.164748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 53/99] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:39 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:40.176606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-55619bbe-cba7-4ba7-ad90-e9118c608ca2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:40.177295 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-55619bbe-cba7-4ba7-ad90-e9118c608ca2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:40.183510 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-55619bbe-cba7-4ba7-ad90-e9118c608ca2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:40.184806 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-55619bbe-cba7-4ba7-ad90-e9118c608ca2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:40.184806 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-55619bbe-cba7-4ba7-ad90-e9118c608ca2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:40.185340 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-55619bbe-cba7-4ba7-ad90-e9118c608ca2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:40.185795 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-55619bbe-cba7-4ba7-ad90-e9118c608ca2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:40.186262 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-55619bbe-cba7-4ba7-ad90-e9118c608ca2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:40.215328 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-26107aa3-3da9-4771-a13c-482a55247f55 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:40.223086 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-26107aa3-3da9-4771-a13c-482a55247f55 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1284 microversion: 2.1 time: 0.085480 Sep 02 05:23:40.223618 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 47/100] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:40 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:40.318419 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-55619bbe-cba7-4ba7-ad90-e9118c608ca2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:40.326110 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-55619bbe-cba7-4ba7-ad90-e9118c608ca2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.153079 Sep 02 05:23:40.326663 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 54/101] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:40 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:40.333895 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-8f722460-8e00-4280-b9a5-f4132561cff1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:40.334964 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-8f722460-8e00-4280-b9a5-f4132561cff1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:40.341294 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8f722460-8e00-4280-b9a5-f4132561cff1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:40.342464 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8f722460-8e00-4280-b9a5-f4132561cff1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:40.342886 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8f722460-8e00-4280-b9a5-f4132561cff1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:40.343562 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8f722460-8e00-4280-b9a5-f4132561cff1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:40.344005 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8f722460-8e00-4280-b9a5-f4132561cff1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:40.344448 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8f722460-8e00-4280-b9a5-f4132561cff1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:40.413970 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-8f722460-8e00-4280-b9a5-f4132561cff1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:40.422404 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-8f722460-8e00-4280-b9a5-f4132561cff1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:40.423813 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-8f722460-8e00-4280-b9a5-f4132561cff1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:40.424926 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-8f722460-8e00-4280-b9a5-f4132561cff1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1351 microversion: 2.20 time: 0.095001 Sep 02 05:23:40.425487 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 48/102] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:23:40 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1351 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:23:41.187447 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-19578634-4ef3-462b-8b0a-95cc0c1b1ffa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:41.188031 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-19578634-4ef3-462b-8b0a-95cc0c1b1ffa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:41.194337 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19578634-4ef3-462b-8b0a-95cc0c1b1ffa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:41.194810 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19578634-4ef3-462b-8b0a-95cc0c1b1ffa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:41.195230 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19578634-4ef3-462b-8b0a-95cc0c1b1ffa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:41.195905 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19578634-4ef3-462b-8b0a-95cc0c1b1ffa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:41.196403 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19578634-4ef3-462b-8b0a-95cc0c1b1ffa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:41.196812 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19578634-4ef3-462b-8b0a-95cc0c1b1ffa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:41.244248 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-e725fdee-4eb1-4178-ad32-bb6283bb8ead tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:41.244853 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-e725fdee-4eb1-4178-ad32-bb6283bb8ead tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:41.251604 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e725fdee-4eb1-4178-ad32-bb6283bb8ead tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:41.252092 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e725fdee-4eb1-4178-ad32-bb6283bb8ead tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:41.252552 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e725fdee-4eb1-4178-ad32-bb6283bb8ead tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:41.253261 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e725fdee-4eb1-4178-ad32-bb6283bb8ead tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:41.253717 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e725fdee-4eb1-4178-ad32-bb6283bb8ead tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:41.254142 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e725fdee-4eb1-4178-ad32-bb6283bb8ead tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:41.258303 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=100 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:41.329159 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e725fdee-4eb1-4178-ad32-bb6283bb8ead tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:41.336991 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-e725fdee-4eb1-4178-ad32-bb6283bb8ead tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1284 microversion: 2.1 time: 0.096999 Sep 02 05:23:41.337972 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 49/103] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:41 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:41.353832 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-19578634-4ef3-462b-8b0a-95cc0c1b1ffa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:41.356671 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-14b85217-dda0-43f2-bd31-3a96ccebadbf tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:41.357616 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-14b85217-dda0-43f2-bd31-3a96ccebadbf tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:41.365528 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-14b85217-dda0-43f2-bd31-3a96ccebadbf tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:41.366369 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-14b85217-dda0-43f2-bd31-3a96ccebadbf tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:41.367557 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-14b85217-dda0-43f2-bd31-3a96ccebadbf tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:41.367680 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-19578634-4ef3-462b-8b0a-95cc0c1b1ffa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.184452 Sep 02 05:23:41.367803 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-14b85217-dda0-43f2-bd31-3a96ccebadbf tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:41.374587 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-14b85217-dda0-43f2-bd31-3a96ccebadbf tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:41.375009 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 55/104] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:41 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:41.375097 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-14b85217-dda0-43f2-bd31-3a96ccebadbf tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:41.447940 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-5fcbeaef-ab2c-4c3b-bc75-9b8212ecfda5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:41.448520 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-5fcbeaef-ab2c-4c3b-bc75-9b8212ecfda5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:41.455638 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5fcbeaef-ab2c-4c3b-bc75-9b8212ecfda5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:41.456147 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5fcbeaef-ab2c-4c3b-bc75-9b8212ecfda5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:41.456712 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5fcbeaef-ab2c-4c3b-bc75-9b8212ecfda5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:41.457446 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5fcbeaef-ab2c-4c3b-bc75-9b8212ecfda5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:41.457942 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5fcbeaef-ab2c-4c3b-bc75-9b8212ecfda5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:41.458389 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5fcbeaef-ab2c-4c3b-bc75-9b8212ecfda5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:41.540606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-5fcbeaef-ab2c-4c3b-bc75-9b8212ecfda5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:41.544314 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-14b85217-dda0-43f2-bd31-3a96ccebadbf tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:41.549381 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-5fcbeaef-ab2c-4c3b-bc75-9b8212ecfda5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:41.550812 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-5fcbeaef-ab2c-4c3b-bc75-9b8212ecfda5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:41.551910 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-5fcbeaef-ab2c-4c3b-bc75-9b8212ecfda5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1351 microversion: 2.20 time: 0.108285 Sep 02 05:23:41.552331 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-14b85217-dda0-43f2-bd31-3a96ccebadbf tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.202171 Sep 02 05:23:41.552524 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 56/105] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:23:41 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1351 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:23:41.553411 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 50/106] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:41 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:42.360260 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-6c6a3126-507e-4cc3-87ef-725454a25d3f tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:42.361157 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-6c6a3126-507e-4cc3-87ef-725454a25d3f tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:42.370851 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6c6a3126-507e-4cc3-87ef-725454a25d3f tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:42.371636 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6c6a3126-507e-4cc3-87ef-725454a25d3f tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:42.372356 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6c6a3126-507e-4cc3-87ef-725454a25d3f tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:42.373537 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6c6a3126-507e-4cc3-87ef-725454a25d3f tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:42.374198 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6c6a3126-507e-4cc3-87ef-725454a25d3f tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:42.374808 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6c6a3126-507e-4cc3-87ef-725454a25d3f tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:42.390383 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-30b8db36-48e0-4f18-8ba7-d942fbf82466 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:42.391395 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-30b8db36-48e0-4f18-8ba7-d942fbf82466 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:42.397941 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-30b8db36-48e0-4f18-8ba7-d942fbf82466 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:42.398598 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-30b8db36-48e0-4f18-8ba7-d942fbf82466 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:42.399289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-30b8db36-48e0-4f18-8ba7-d942fbf82466 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:42.400084 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-30b8db36-48e0-4f18-8ba7-d942fbf82466 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:42.400701 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-30b8db36-48e0-4f18-8ba7-d942fbf82466 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:42.401745 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-30b8db36-48e0-4f18-8ba7-d942fbf82466 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:42.469357 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-6c6a3126-507e-4cc3-87ef-725454a25d3f tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:42.481682 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-6c6a3126-507e-4cc3-87ef-725454a25d3f tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1284 microversion: 2.1 time: 0.126511 Sep 02 05:23:42.492346 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 57/107] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:42 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:42.571168 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-30b8db36-48e0-4f18-8ba7-d942fbf82466 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:42.575387 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-4f7d82a2-fd73-4fff-b930-b59338d930c6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:42.576003 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-4f7d82a2-fd73-4fff-b930-b59338d930c6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:42.581930 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4f7d82a2-fd73-4fff-b930-b59338d930c6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:42.582105 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-30b8db36-48e0-4f18-8ba7-d942fbf82466 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.195811 Sep 02 05:23:42.582699 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 51/108] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:42 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:23:42.583524 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4f7d82a2-fd73-4fff-b930-b59338d930c6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:42.583959 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4f7d82a2-fd73-4fff-b930-b59338d930c6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:42.584699 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4f7d82a2-fd73-4fff-b930-b59338d930c6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:42.585143 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4f7d82a2-fd73-4fff-b930-b59338d930c6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:42.585563 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4f7d82a2-fd73-4fff-b930-b59338d930c6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:42.589285 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-65ae632b-e4ac-4807-ae4e-c7a75c5b6a9c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:42.590207 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-65ae632b-e4ac-4807-ae4e-c7a75c5b6a9c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:42.596783 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-65ae632b-e4ac-4807-ae4e-c7a75c5b6a9c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:42.597534 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-65ae632b-e4ac-4807-ae4e-c7a75c5b6a9c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:42.598004 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-65ae632b-e4ac-4807-ae4e-c7a75c5b6a9c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:42.598865 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-65ae632b-e4ac-4807-ae4e-c7a75c5b6a9c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:42.599319 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-65ae632b-e4ac-4807-ae4e-c7a75c5b6a9c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:42.599735 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-65ae632b-e4ac-4807-ae4e-c7a75c5b6a9c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:42.667304 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-4f7d82a2-fd73-4fff-b930-b59338d930c6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:42.675612 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-4f7d82a2-fd73-4fff-b930-b59338d930c6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:42.677060 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-4f7d82a2-fd73-4fff-b930-b59338d930c6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:42.678181 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-4f7d82a2-fd73-4fff-b930-b59338d930c6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1351 microversion: 2.20 time: 0.107774 Sep 02 05:23:42.678737 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 58/109] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:23:42 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:23:42.758439 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-65ae632b-e4ac-4807-ae4e-c7a75c5b6a9c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:42.768963 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-65ae632b-e4ac-4807-ae4e-c7a75c5b6a9c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.185030 Sep 02 05:23:42.769648 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 52/110] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:42 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:43.506916 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-2652bf8f-5132-4bf9-9542-7ee420cb22e7 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:43.509224 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-2652bf8f-5132-4bf9-9542-7ee420cb22e7 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:43.517814 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2652bf8f-5132-4bf9-9542-7ee420cb22e7 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:43.518451 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2652bf8f-5132-4bf9-9542-7ee420cb22e7 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:43.519037 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2652bf8f-5132-4bf9-9542-7ee420cb22e7 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:43.520196 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2652bf8f-5132-4bf9-9542-7ee420cb22e7 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:43.520788 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2652bf8f-5132-4bf9-9542-7ee420cb22e7 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:43.521481 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2652bf8f-5132-4bf9-9542-7ee420cb22e7 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:43.605733 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-7c90784a-5914-48f3-b8ee-1103a7507211 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:43.607124 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-7c90784a-5914-48f3-b8ee-1103a7507211 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:43.615459 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7c90784a-5914-48f3-b8ee-1103a7507211 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:43.615948 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7c90784a-5914-48f3-b8ee-1103a7507211 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:43.616874 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7c90784a-5914-48f3-b8ee-1103a7507211 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:43.617969 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7c90784a-5914-48f3-b8ee-1103a7507211 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:43.620537 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7c90784a-5914-48f3-b8ee-1103a7507211 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:43.620974 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7c90784a-5914-48f3-b8ee-1103a7507211 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:43.624626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-2652bf8f-5132-4bf9-9542-7ee420cb22e7 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:43.634990 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-2652bf8f-5132-4bf9-9542-7ee420cb22e7 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1272 microversion: 2.1 time: 0.134494 Sep 02 05:23:43.636324 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 59/111] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:43 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1272 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:43.701255 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-db55cc88-780c-45ba-89c8-55f1b6409a88 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:43.701961 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-db55cc88-780c-45ba-89c8-55f1b6409a88 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:43.707931 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-db55cc88-780c-45ba-89c8-55f1b6409a88 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:43.708739 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-db55cc88-780c-45ba-89c8-55f1b6409a88 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:43.709392 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-db55cc88-780c-45ba-89c8-55f1b6409a88 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:43.710291 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-db55cc88-780c-45ba-89c8-55f1b6409a88 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:43.710933 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-db55cc88-780c-45ba-89c8-55f1b6409a88 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:43.711549 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-db55cc88-780c-45ba-89c8-55f1b6409a88 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:43.961794 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-db55cc88-780c-45ba-89c8-55f1b6409a88 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:43.973352 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-db55cc88-780c-45ba-89c8-55f1b6409a88 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:43.974784 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-db55cc88-780c-45ba-89c8-55f1b6409a88 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:43.975882 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-db55cc88-780c-45ba-89c8-55f1b6409a88 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1339 microversion: 2.20 time: 0.278735 Sep 02 05:23:43.980619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 60/112] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:23:43 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1339 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:23:43.985402 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-39800b99-5a67-4f85-8582-eb5caa50b50f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:43.986194 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-39800b99-5a67-4f85-8582-eb5caa50b50f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:43.997742 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-39800b99-5a67-4f85-8582-eb5caa50b50f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:43.998478 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-39800b99-5a67-4f85-8582-eb5caa50b50f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:43.998910 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-39800b99-5a67-4f85-8582-eb5caa50b50f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:43.999630 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-39800b99-5a67-4f85-8582-eb5caa50b50f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:44.000279 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-39800b99-5a67-4f85-8582-eb5caa50b50f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:44.000704 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-39800b99-5a67-4f85-8582-eb5caa50b50f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:44.069375 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-7c90784a-5914-48f3-b8ee-1103a7507211 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:44.078481 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-7c90784a-5914-48f3-b8ee-1103a7507211 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.477563 Sep 02 05:23:44.079429 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 53/113] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:43 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:23:44.245914 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-39800b99-5a67-4f85-8582-eb5caa50b50f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:44.260145 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-39800b99-5a67-4f85-8582-eb5caa50b50f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.278181 Sep 02 05:23:44.261389 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 61/114] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:43 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:44.668709 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-c8ddcc53-7ccc-4bfd-b7a2-0a4d9525ed98 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:44.671007 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-c8ddcc53-7ccc-4bfd-b7a2-0a4d9525ed98 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:44.681528 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c8ddcc53-7ccc-4bfd-b7a2-0a4d9525ed98 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:44.683989 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c8ddcc53-7ccc-4bfd-b7a2-0a4d9525ed98 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:44.684629 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c8ddcc53-7ccc-4bfd-b7a2-0a4d9525ed98 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:44.686588 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c8ddcc53-7ccc-4bfd-b7a2-0a4d9525ed98 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:44.688876 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c8ddcc53-7ccc-4bfd-b7a2-0a4d9525ed98 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:44.699791 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c8ddcc53-7ccc-4bfd-b7a2-0a4d9525ed98 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:44.812329 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-c8ddcc53-7ccc-4bfd-b7a2-0a4d9525ed98 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:44.821564 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-c8ddcc53-7ccc-4bfd-b7a2-0a4d9525ed98 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1272 microversion: 2.1 time: 0.167352 Sep 02 05:23:44.822462 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 54/115] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:44 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1272 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:45.004293 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d9153081-b23f-4dd9-b94b-5ba6a3e995db tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:45.005601 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-d9153081-b23f-4dd9-b94b-5ba6a3e995db tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:45.016275 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d9153081-b23f-4dd9-b94b-5ba6a3e995db tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:45.021042 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d9153081-b23f-4dd9-b94b-5ba6a3e995db tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:45.021695 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d9153081-b23f-4dd9-b94b-5ba6a3e995db tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:45.022672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d9153081-b23f-4dd9-b94b-5ba6a3e995db tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:45.025048 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d9153081-b23f-4dd9-b94b-5ba6a3e995db tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:45.027580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d9153081-b23f-4dd9-b94b-5ba6a3e995db tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:45.102421 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-9833e2ce-9031-4111-88fc-1dac45085700 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:45.103812 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-9833e2ce-9031-4111-88fc-1dac45085700 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:45.122421 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9833e2ce-9031-4111-88fc-1dac45085700 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:45.123339 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9833e2ce-9031-4111-88fc-1dac45085700 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:45.124347 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9833e2ce-9031-4111-88fc-1dac45085700 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:45.125370 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9833e2ce-9031-4111-88fc-1dac45085700 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:45.126216 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9833e2ce-9031-4111-88fc-1dac45085700 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:45.127059 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9833e2ce-9031-4111-88fc-1dac45085700 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:45.151561 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d9153081-b23f-4dd9-b94b-5ba6a3e995db tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:45.174804 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d9153081-b23f-4dd9-b94b-5ba6a3e995db tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:45.179450 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d9153081-b23f-4dd9-b94b-5ba6a3e995db tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:45.182742 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-d9153081-b23f-4dd9-b94b-5ba6a3e995db tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1339 microversion: 2.20 time: 0.183694 Sep 02 05:23:45.187574 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 62/116] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:23:44 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1339 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:23:45.283668 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-12c00a00-a968-4738-ad6a-2ba9ff50252b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:45.284421 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-12c00a00-a968-4738-ad6a-2ba9ff50252b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:45.295310 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-12c00a00-a968-4738-ad6a-2ba9ff50252b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:45.298787 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-12c00a00-a968-4738-ad6a-2ba9ff50252b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:45.298787 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-12c00a00-a968-4738-ad6a-2ba9ff50252b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:45.299381 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-12c00a00-a968-4738-ad6a-2ba9ff50252b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:45.301114 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-12c00a00-a968-4738-ad6a-2ba9ff50252b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:45.303022 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-12c00a00-a968-4738-ad6a-2ba9ff50252b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:45.362554 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-9833e2ce-9031-4111-88fc-1dac45085700 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:45.372817 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-9833e2ce-9031-4111-88fc-1dac45085700 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.274930 Sep 02 05:23:45.374589 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 55/117] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:45 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:45.495072 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-12c00a00-a968-4738-ad6a-2ba9ff50252b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:45.510171 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-12c00a00-a968-4738-ad6a-2ba9ff50252b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.232431 Sep 02 05:23:45.513740 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 63/118] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:45 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:45.850574 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-c56ef155-e400-45c9-adef-1039c5ee5d58 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:45.852029 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-c56ef155-e400-45c9-adef-1039c5ee5d58 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:45.859452 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c56ef155-e400-45c9-adef-1039c5ee5d58 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:45.865589 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c56ef155-e400-45c9-adef-1039c5ee5d58 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:45.866567 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c56ef155-e400-45c9-adef-1039c5ee5d58 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:45.868624 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c56ef155-e400-45c9-adef-1039c5ee5d58 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:45.870068 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c56ef155-e400-45c9-adef-1039c5ee5d58 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:45.872387 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c56ef155-e400-45c9-adef-1039c5ee5d58 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:46.144109 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-e7d651e8-c387-4f5c-b123-2d2a5020189b req-25c181d9-337f-4a1e-9af1-6dbb6663ef0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ecefc31-2d93-4601-91e7-0d18da502d8b", "tag": "5c422bbe-4e68-47eb-b4b1-26e72bf162b6"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:23:46.155151 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-e7d651e8-c387-4f5c-b123-2d2a5020189b req-25c181d9-337f-4a1e-9af1-6dbb6663ef0c service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:46.157048 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-e7d651e8-c387-4f5c-b123-2d2a5020189b req-25c181d9-337f-4a1e-9af1-6dbb6663ef0c service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:46.158544 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-e7d651e8-c387-4f5c-b123-2d2a5020189b req-25c181d9-337f-4a1e-9af1-6dbb6663ef0c service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:46.173055 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-e7d651e8-c387-4f5c-b123-2d2a5020189b req-25c181d9-337f-4a1e-9af1-6dbb6663ef0c service nova] Creating event network-changed:5c422bbe-4e68-47eb-b4b1-26e72bf162b6 for instance 6ecefc31-2d93-4601-91e7-0d18da502d8b on hv-cinder-85391 Sep 02 05:23:46.177256 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-c56ef155-e400-45c9-adef-1039c5ee5d58 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:46.179269 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-e7d651e8-c387-4f5c-b123-2d2a5020189b req-25c181d9-337f-4a1e-9af1-6dbb6663ef0c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134506 Sep 02 05:23:46.181675 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 64/119] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:23:46.185738 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-c56ef155-e400-45c9-adef-1039c5ee5d58 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.347360 Sep 02 05:23:46.186829 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 56/120] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:45 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:46.216706 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-3836f3ed-20b8-4279-ae98-c1ffed20b9b7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:46.217550 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-3836f3ed-20b8-4279-ae98-c1ffed20b9b7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:46.225592 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3836f3ed-20b8-4279-ae98-c1ffed20b9b7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:46.226571 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3836f3ed-20b8-4279-ae98-c1ffed20b9b7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:46.227362 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3836f3ed-20b8-4279-ae98-c1ffed20b9b7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:46.228631 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3836f3ed-20b8-4279-ae98-c1ffed20b9b7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:46.229283 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3836f3ed-20b8-4279-ae98-c1ffed20b9b7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:46.230010 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3836f3ed-20b8-4279-ae98-c1ffed20b9b7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:46.394592 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-53f1b7b4-111f-4045-9710-e5b7dc0cbdfe tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:46.395289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-53f1b7b4-111f-4045-9710-e5b7dc0cbdfe tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:46.402168 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-53f1b7b4-111f-4045-9710-e5b7dc0cbdfe tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:46.403151 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-53f1b7b4-111f-4045-9710-e5b7dc0cbdfe tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:46.403820 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-53f1b7b4-111f-4045-9710-e5b7dc0cbdfe tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:46.404852 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-53f1b7b4-111f-4045-9710-e5b7dc0cbdfe tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:46.405495 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-53f1b7b4-111f-4045-9710-e5b7dc0cbdfe tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:46.406089 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-53f1b7b4-111f-4045-9710-e5b7dc0cbdfe tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:46.406700 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-3836f3ed-20b8-4279-ae98-c1ffed20b9b7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:46.417395 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-3836f3ed-20b8-4279-ae98-c1ffed20b9b7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:46.419216 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-3836f3ed-20b8-4279-ae98-c1ffed20b9b7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:46.420689 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-3836f3ed-20b8-4279-ae98-c1ffed20b9b7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1405 microversion: 2.20 time: 0.209235 Sep 02 05:23:46.421691 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 65/121] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:23:46 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1405 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:23:46.535424 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-0cecd225-4c8e-4001-a944-527f160e85b6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:46.536946 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-0cecd225-4c8e-4001-a944-527f160e85b6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:46.548806 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0cecd225-4c8e-4001-a944-527f160e85b6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:46.549648 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0cecd225-4c8e-4001-a944-527f160e85b6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:46.550183 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0cecd225-4c8e-4001-a944-527f160e85b6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:46.550977 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0cecd225-4c8e-4001-a944-527f160e85b6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:46.551530 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0cecd225-4c8e-4001-a944-527f160e85b6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:46.552071 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0cecd225-4c8e-4001-a944-527f160e85b6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:46.566341 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-53f1b7b4-111f-4045-9710-e5b7dc0cbdfe tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:46.575726 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-53f1b7b4-111f-4045-9710-e5b7dc0cbdfe tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.184926 Sep 02 05:23:46.577193 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 57/122] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:46 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:46.698001 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-0cecd225-4c8e-4001-a944-527f160e85b6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:46.711572 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-0cecd225-4c8e-4001-a944-527f160e85b6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.181481 Sep 02 05:23:46.712163 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 66/123] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:46 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:23:47.209408 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-c548ba28-fa76-4db1-b819-c15580bf7ecc tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:47.210064 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-c548ba28-fa76-4db1-b819-c15580bf7ecc tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:47.234804 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c548ba28-fa76-4db1-b819-c15580bf7ecc tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:47.234804 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c548ba28-fa76-4db1-b819-c15580bf7ecc tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:47.235165 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c548ba28-fa76-4db1-b819-c15580bf7ecc tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:47.235718 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c548ba28-fa76-4db1-b819-c15580bf7ecc tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:47.236425 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c548ba28-fa76-4db1-b819-c15580bf7ecc tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:47.236425 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c548ba28-fa76-4db1-b819-c15580bf7ecc tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:47.424143 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-c548ba28-fa76-4db1-b819-c15580bf7ecc tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:47.433339 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-c548ba28-fa76-4db1-b819-c15580bf7ecc tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.227363 Sep 02 05:23:47.443266 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f7aba4f1-8f07-4483-b279-335896dedd2b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:47.443884 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f7aba4f1-8f07-4483-b279-335896dedd2b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:47.447567 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 58/124] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:47 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:47.450585 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f7aba4f1-8f07-4483-b279-335896dedd2b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:47.451141 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f7aba4f1-8f07-4483-b279-335896dedd2b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:47.451517 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f7aba4f1-8f07-4483-b279-335896dedd2b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:47.452299 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f7aba4f1-8f07-4483-b279-335896dedd2b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:47.452771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f7aba4f1-8f07-4483-b279-335896dedd2b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:47.453205 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f7aba4f1-8f07-4483-b279-335896dedd2b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:47.596916 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-1c11aec3-1206-46fd-9897-4eb5fa84c4fb tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:47.597628 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-1c11aec3-1206-46fd-9897-4eb5fa84c4fb tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:47.605860 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1c11aec3-1206-46fd-9897-4eb5fa84c4fb tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:47.606368 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1c11aec3-1206-46fd-9897-4eb5fa84c4fb tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:47.606986 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1c11aec3-1206-46fd-9897-4eb5fa84c4fb tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:47.612037 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1c11aec3-1206-46fd-9897-4eb5fa84c4fb tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:47.612583 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1c11aec3-1206-46fd-9897-4eb5fa84c4fb tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:47.613029 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1c11aec3-1206-46fd-9897-4eb5fa84c4fb tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:47.621211 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f7aba4f1-8f07-4483-b279-335896dedd2b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:47.647130 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f7aba4f1-8f07-4483-b279-335896dedd2b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:47.651591 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f7aba4f1-8f07-4483-b279-335896dedd2b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:47.652815 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f7aba4f1-8f07-4483-b279-335896dedd2b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1405 microversion: 2.20 time: 0.213722 Sep 02 05:23:47.654438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 67/125] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:23:47 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1405 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:23:47.734609 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-013775ba-2420-4d0c-97fc-ad1a1dc83d7d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:47.735350 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-013775ba-2420-4d0c-97fc-ad1a1dc83d7d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:47.742409 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-013775ba-2420-4d0c-97fc-ad1a1dc83d7d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:47.743358 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-013775ba-2420-4d0c-97fc-ad1a1dc83d7d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:47.744341 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-013775ba-2420-4d0c-97fc-ad1a1dc83d7d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:47.745246 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-013775ba-2420-4d0c-97fc-ad1a1dc83d7d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:47.745920 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-013775ba-2420-4d0c-97fc-ad1a1dc83d7d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:47.746577 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-013775ba-2420-4d0c-97fc-ad1a1dc83d7d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:47.764741 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1c11aec3-1206-46fd-9897-4eb5fa84c4fb tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:47.772952 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-1c11aec3-1206-46fd-9897-4eb5fa84c4fb tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.179728 Sep 02 05:23:47.773715 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 59/126] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:47 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:23:47.889677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-013775ba-2420-4d0c-97fc-ad1a1dc83d7d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:47.898033 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-013775ba-2420-4d0c-97fc-ad1a1dc83d7d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.168279 Sep 02 05:23:47.898537 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 68/127] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:47 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:23:48.207453 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-82e1ff6f-b3c9-4b96-8cec-de82fbdf66d7 req-574a286e-1ccc-4ff9-93fb-f7f23f4ed0af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ca0f78c-4691-4690-8772-c9fd6cfde418", "tag": "e4be745a-a91e-4f61-b12b-42bd38befb73"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:23:48.221340 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-82e1ff6f-b3c9-4b96-8cec-de82fbdf66d7 req-574a286e-1ccc-4ff9-93fb-f7f23f4ed0af service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:48.221919 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-82e1ff6f-b3c9-4b96-8cec-de82fbdf66d7 req-574a286e-1ccc-4ff9-93fb-f7f23f4ed0af service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:48.222233 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-82e1ff6f-b3c9-4b96-8cec-de82fbdf66d7 req-574a286e-1ccc-4ff9-93fb-f7f23f4ed0af service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:48.253962 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-82e1ff6f-b3c9-4b96-8cec-de82fbdf66d7 req-574a286e-1ccc-4ff9-93fb-f7f23f4ed0af service nova] Creating event network-changed:e4be745a-a91e-4f61-b12b-42bd38befb73 for instance 7ca0f78c-4691-4690-8772-c9fd6cfde418 on hv-cinder-85391 Sep 02 05:23:48.254485 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-82e1ff6f-b3c9-4b96-8cec-de82fbdf66d7 req-574a286e-1ccc-4ff9-93fb-f7f23f4ed0af service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120449) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 02 05:23:48.254869 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-82e1ff6f-b3c9-4b96-8cec-de82fbdf66d7 req-574a286e-1ccc-4ff9-93fb-f7f23f4ed0af service nova] Acquired lock "compute-rpcapi-router" {{(pid=120449) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 02 05:23:48.256039 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c77374e4-a2c2-436d-861f-e36b786a073a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:48.256524 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c77374e4-a2c2-436d-861f-e36b786a073a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:48.256945 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c77374e4-a2c2-436d-861f-e36b786a073a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:48.257773 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c77374e4-a2c2-436d-861f-e36b786a073a None None] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:48.258234 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c77374e4-a2c2-436d-861f-e36b786a073a None None] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:48.259341 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c77374e4-a2c2-436d-861f-e36b786a073a None None] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:48.269160 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.compute.rpcapi [None req-c77374e4-a2c2-436d-861f-e36b786a073a None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 02 05:23:48.270046 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c77374e4-a2c2-436d-861f-e36b786a073a None None] Releasing lock "compute-rpcapi-router" {{(pid=120449) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 02 05:23:48.286082 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-c77374e4-a2c2-436d-861f-e36b786a073a None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082445 Sep 02 05:23:48.287166 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 60/128] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:23:48.457161 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-91c37bf9-482f-4471-8ba1-17fe92026c7a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:48.457896 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-91c37bf9-482f-4471-8ba1-17fe92026c7a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:48.465773 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-91c37bf9-482f-4471-8ba1-17fe92026c7a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:48.466762 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-91c37bf9-482f-4471-8ba1-17fe92026c7a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:48.467279 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-91c37bf9-482f-4471-8ba1-17fe92026c7a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:48.468410 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-91c37bf9-482f-4471-8ba1-17fe92026c7a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:48.468953 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-91c37bf9-482f-4471-8ba1-17fe92026c7a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:48.469567 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-91c37bf9-482f-4471-8ba1-17fe92026c7a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:48.681576 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-f83e8a21-ba1e-4744-831d-3878e17255de tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:48.682879 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-f83e8a21-ba1e-4744-831d-3878e17255de tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:48.691936 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f83e8a21-ba1e-4744-831d-3878e17255de tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:48.692807 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f83e8a21-ba1e-4744-831d-3878e17255de tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:48.693582 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f83e8a21-ba1e-4744-831d-3878e17255de tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:48.694514 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f83e8a21-ba1e-4744-831d-3878e17255de tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:48.695166 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f83e8a21-ba1e-4744-831d-3878e17255de tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:48.695785 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f83e8a21-ba1e-4744-831d-3878e17255de tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:49.001187 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-91c37bf9-482f-4471-8ba1-17fe92026c7a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:49.020989 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-91c37bf9-482f-4471-8ba1-17fe92026c7a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.567708 Sep 02 05:23:49.023757 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 69/129] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:48 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:49.027433 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-f83e8a21-ba1e-4744-831d-3878e17255de tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:49.040317 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-f83e8a21-ba1e-4744-831d-3878e17255de tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:49.041152 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-ce72bda4-fd83-4078-83ac-b195ef2d3289 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:49.042538 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-f83e8a21-ba1e-4744-831d-3878e17255de tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:49.043686 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-ce72bda4-fd83-4078-83ac-b195ef2d3289 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:49.045088 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-f83e8a21-ba1e-4744-831d-3878e17255de tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1405 microversion: 2.20 time: 0.368219 Sep 02 05:23:49.048587 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 61/130] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:23:48 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1405 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:23:49.058050 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ce72bda4-fd83-4078-83ac-b195ef2d3289 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:49.058802 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ce72bda4-fd83-4078-83ac-b195ef2d3289 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:49.059367 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ce72bda4-fd83-4078-83ac-b195ef2d3289 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:49.063909 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-7a3f6f7f-149f-4508-a8b7-8cc52f6fe87a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:49.065022 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-7a3f6f7f-149f-4508-a8b7-8cc52f6fe87a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:49.067784 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ce72bda4-fd83-4078-83ac-b195ef2d3289 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:49.068586 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ce72bda4-fd83-4078-83ac-b195ef2d3289 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:49.069195 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ce72bda4-fd83-4078-83ac-b195ef2d3289 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:49.076170 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7a3f6f7f-149f-4508-a8b7-8cc52f6fe87a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:49.076902 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7a3f6f7f-149f-4508-a8b7-8cc52f6fe87a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:49.077632 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7a3f6f7f-149f-4508-a8b7-8cc52f6fe87a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:49.078660 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7a3f6f7f-149f-4508-a8b7-8cc52f6fe87a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:49.079306 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7a3f6f7f-149f-4508-a8b7-8cc52f6fe87a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:49.079941 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7a3f6f7f-149f-4508-a8b7-8cc52f6fe87a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:49.292927 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-7a3f6f7f-149f-4508-a8b7-8cc52f6fe87a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:49.294735 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-ce72bda4-fd83-4078-83ac-b195ef2d3289 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:49.303375 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-7a3f6f7f-149f-4508-a8b7-8cc52f6fe87a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.250902 Sep 02 05:23:49.307916 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 62/131] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:49 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:49.312830 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-ce72bda4-fd83-4078-83ac-b195ef2d3289 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.280826 Sep 02 05:23:49.313472 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 70/132] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:49 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:50.045316 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-d5095e92-968b-4894-ab0b-d989fe95514f tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:50.045984 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-d5095e92-968b-4894-ab0b-d989fe95514f tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:50.052610 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d5095e92-968b-4894-ab0b-d989fe95514f tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:50.053264 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d5095e92-968b-4894-ab0b-d989fe95514f tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:50.053969 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d5095e92-968b-4894-ab0b-d989fe95514f tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:50.054921 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d5095e92-968b-4894-ab0b-d989fe95514f tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:50.055556 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d5095e92-968b-4894-ab0b-d989fe95514f tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:50.056176 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d5095e92-968b-4894-ab0b-d989fe95514f tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:50.071161 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-35cffe00-92e5-4b7d-b004-74634a32e396 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:50.071756 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-35cffe00-92e5-4b7d-b004-74634a32e396 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:50.079641 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-35cffe00-92e5-4b7d-b004-74634a32e396 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:50.080243 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-35cffe00-92e5-4b7d-b004-74634a32e396 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:50.080877 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-35cffe00-92e5-4b7d-b004-74634a32e396 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:50.081805 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-35cffe00-92e5-4b7d-b004-74634a32e396 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:50.082448 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-35cffe00-92e5-4b7d-b004-74634a32e396 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:50.083069 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-35cffe00-92e5-4b7d-b004-74634a32e396 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:50.088858 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=100 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:50.279299 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-d5095e92-968b-4894-ab0b-d989fe95514f tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:50.293283 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-d5095e92-968b-4894-ab0b-d989fe95514f tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.253139 Sep 02 05:23:50.295242 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 63/133] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:50 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:23:50.311533 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-35cffe00-92e5-4b7d-b004-74634a32e396 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:50.319563 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-55323dcd-e570-4664-9d6e-288ae2bc64bb req-e805d814-e6a6-4542-b2ec-a2c9b283c86e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47", "tag": "a32283d3-a932-4202-9e94-3dce7c235497"}, {"name": "network-changed", "server_uuid": "1e32b402-d6f2-4861-a864-005e1a9f808d", "tag": "26f374c2-ecf9-4064-b5ad-13f47d97521e"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:23:50.320662 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-35cffe00-92e5-4b7d-b004-74634a32e396 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:50.322673 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-35cffe00-92e5-4b7d-b004-74634a32e396 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:50.324345 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-35cffe00-92e5-4b7d-b004-74634a32e396 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1405 microversion: 2.20 time: 0.257321 Sep 02 05:23:50.330985 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-55323dcd-e570-4664-9d6e-288ae2bc64bb req-e805d814-e6a6-4542-b2ec-a2c9b283c86e service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:50.331702 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-55323dcd-e570-4664-9d6e-288ae2bc64bb req-e805d814-e6a6-4542-b2ec-a2c9b283c86e service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:50.332332 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-55323dcd-e570-4664-9d6e-288ae2bc64bb req-e805d814-e6a6-4542-b2ec-a2c9b283c86e service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:50.337219 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 71/134] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:23:50 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1405 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:23:50.347083 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-55323dcd-e570-4664-9d6e-288ae2bc64bb req-e805d814-e6a6-4542-b2ec-a2c9b283c86e service nova] Creating event network-changed:a32283d3-a932-4202-9e94-3dce7c235497 for instance 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 on hv-cinder-85391 Sep 02 05:23:50.347515 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d87c5504-ddb1-4b6a-afca-2884491e0292 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:50.347622 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-55323dcd-e570-4664-9d6e-288ae2bc64bb req-e805d814-e6a6-4542-b2ec-a2c9b283c86e service nova] Creating event network-changed:26f374c2-ecf9-4064-b5ad-13f47d97521e for instance 1e32b402-d6f2-4861-a864-005e1a9f808d on hv-cinder-85391 Sep 02 05:23:50.348356 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-d87c5504-ddb1-4b6a-afca-2884491e0292 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:50.354218 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-55323dcd-e570-4664-9d6e-288ae2bc64bb req-e805d814-e6a6-4542-b2ec-a2c9b283c86e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.040520 Sep 02 05:23:50.354800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 64/135] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:23:50.356041 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d87c5504-ddb1-4b6a-afca-2884491e0292 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:50.356711 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d87c5504-ddb1-4b6a-afca-2884491e0292 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:50.357250 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d87c5504-ddb1-4b6a-afca-2884491e0292 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:50.358542 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d87c5504-ddb1-4b6a-afca-2884491e0292 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:50.359253 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d87c5504-ddb1-4b6a-afca-2884491e0292 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:50.359985 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d87c5504-ddb1-4b6a-afca-2884491e0292 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:50.360921 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-92ae053a-46cc-4cb8-8807-a270b5903ebe tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:50.362034 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-92ae053a-46cc-4cb8-8807-a270b5903ebe tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:50.379541 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-92ae053a-46cc-4cb8-8807-a270b5903ebe tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:50.381408 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-92ae053a-46cc-4cb8-8807-a270b5903ebe tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:50.381850 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-92ae053a-46cc-4cb8-8807-a270b5903ebe tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:50.387581 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-92ae053a-46cc-4cb8-8807-a270b5903ebe tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:50.388027 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-92ae053a-46cc-4cb8-8807-a270b5903ebe tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:50.388621 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-92ae053a-46cc-4cb8-8807-a270b5903ebe tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:50.678048 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d87c5504-ddb1-4b6a-afca-2884491e0292 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:50.687481 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-d87c5504-ddb1-4b6a-afca-2884491e0292 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.343689 Sep 02 05:23:50.688757 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 72/136] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:50 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:50.695043 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-92ae053a-46cc-4cb8-8807-a270b5903ebe tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:50.709123 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-92ae053a-46cc-4cb8-8807-a270b5903ebe tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.352906 Sep 02 05:23:50.709798 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 65/137] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:50 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:51.314954 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-e919243c-f518-4372-b30b-5d37611e4121 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:51.315556 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-e919243c-f518-4372-b30b-5d37611e4121 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:51.321722 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e919243c-f518-4372-b30b-5d37611e4121 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:51.322366 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e919243c-f518-4372-b30b-5d37611e4121 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:51.322859 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e919243c-f518-4372-b30b-5d37611e4121 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:51.323646 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e919243c-f518-4372-b30b-5d37611e4121 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:51.324302 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e919243c-f518-4372-b30b-5d37611e4121 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:51.324729 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e919243c-f518-4372-b30b-5d37611e4121 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:51.353689 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-154fd154-c79c-403d-ae65-14fc57d18371 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:51.353689 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-154fd154-c79c-403d-ae65-14fc57d18371 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:51.357441 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-154fd154-c79c-403d-ae65-14fc57d18371 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:51.357875 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-154fd154-c79c-403d-ae65-14fc57d18371 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:51.358298 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-154fd154-c79c-403d-ae65-14fc57d18371 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:51.358976 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-154fd154-c79c-403d-ae65-14fc57d18371 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:51.359417 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-154fd154-c79c-403d-ae65-14fc57d18371 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:51.359825 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-154fd154-c79c-403d-ae65-14fc57d18371 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:51.563294 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-e919243c-f518-4372-b30b-5d37611e4121 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:51.576068 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-e919243c-f518-4372-b30b-5d37611e4121 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.264879 Sep 02 05:23:51.576765 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 73/138] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:51 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:51.587385 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-154fd154-c79c-403d-ae65-14fc57d18371 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:51.591285 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=100 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:51.600814 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-154fd154-c79c-403d-ae65-14fc57d18371 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:51.602935 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-154fd154-c79c-403d-ae65-14fc57d18371 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:51.604588 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-154fd154-c79c-403d-ae65-14fc57d18371 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1405 microversion: 2.20 time: 0.257865 Sep 02 05:23:51.605589 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 66/139] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:23:51 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1405 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:23:51.709140 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-93ed60f1-b958-42a7-9ae8-e691b6cee969 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:51.710052 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-93ed60f1-b958-42a7-9ae8-e691b6cee969 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:51.716910 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-93ed60f1-b958-42a7-9ae8-e691b6cee969 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:51.717688 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-93ed60f1-b958-42a7-9ae8-e691b6cee969 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:51.718331 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-93ed60f1-b958-42a7-9ae8-e691b6cee969 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:51.719332 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-93ed60f1-b958-42a7-9ae8-e691b6cee969 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:51.720047 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-93ed60f1-b958-42a7-9ae8-e691b6cee969 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:51.720713 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-93ed60f1-b958-42a7-9ae8-e691b6cee969 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:51.735938 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-23375fdc-9341-4704-a36a-40d54214c30e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:51.736619 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-23375fdc-9341-4704-a36a-40d54214c30e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:51.747014 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-23375fdc-9341-4704-a36a-40d54214c30e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:51.748850 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-23375fdc-9341-4704-a36a-40d54214c30e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:51.749287 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-23375fdc-9341-4704-a36a-40d54214c30e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:51.750504 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-23375fdc-9341-4704-a36a-40d54214c30e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:51.751348 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-23375fdc-9341-4704-a36a-40d54214c30e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:51.751823 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-23375fdc-9341-4704-a36a-40d54214c30e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:51.950269 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-23375fdc-9341-4704-a36a-40d54214c30e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:51.958982 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-23375fdc-9341-4704-a36a-40d54214c30e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.226930 Sep 02 05:23:51.976227 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 67/140] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:51 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:23:52.006208 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-93ed60f1-b958-42a7-9ae8-e691b6cee969 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:52.024993 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-93ed60f1-b958-42a7-9ae8-e691b6cee969 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.319605 Sep 02 05:23:52.027378 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 74/141] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:51 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:52.599416 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-091edc5c-e6cd-4323-9991-3bd280ec9da1 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:52.600215 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-091edc5c-e6cd-4323-9991-3bd280ec9da1 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:52.606258 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-091edc5c-e6cd-4323-9991-3bd280ec9da1 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:52.606778 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-091edc5c-e6cd-4323-9991-3bd280ec9da1 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:52.607462 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-091edc5c-e6cd-4323-9991-3bd280ec9da1 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:52.608563 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-091edc5c-e6cd-4323-9991-3bd280ec9da1 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:52.609045 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-091edc5c-e6cd-4323-9991-3bd280ec9da1 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:52.609493 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-091edc5c-e6cd-4323-9991-3bd280ec9da1 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:52.628926 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-0e79a295-0779-42ef-802b-dfdcdc797121 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:52.630209 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-0e79a295-0779-42ef-802b-dfdcdc797121 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:52.636430 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0e79a295-0779-42ef-802b-dfdcdc797121 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:52.636938 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0e79a295-0779-42ef-802b-dfdcdc797121 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:52.637361 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0e79a295-0779-42ef-802b-dfdcdc797121 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:52.638246 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0e79a295-0779-42ef-802b-dfdcdc797121 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:52.638685 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0e79a295-0779-42ef-802b-dfdcdc797121 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:52.639256 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0e79a295-0779-42ef-802b-dfdcdc797121 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:52.811827 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-091edc5c-e6cd-4323-9991-3bd280ec9da1 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:52.820102 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-091edc5c-e6cd-4323-9991-3bd280ec9da1 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.225044 Sep 02 05:23:52.821234 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 68/142] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:52 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:52.877522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-0e79a295-0779-42ef-802b-dfdcdc797121 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:52.890230 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-0e79a295-0779-42ef-802b-dfdcdc797121 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:52.894211 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-0e79a295-0779-42ef-802b-dfdcdc797121 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:52.900152 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-0e79a295-0779-42ef-802b-dfdcdc797121 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1405 microversion: 2.20 time: 0.275825 Sep 02 05:23:52.900841 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 75/143] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:23:52 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1405 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:23:52.989627 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-c1a99e25-94ac-4eab-9ab9-59f4f705a60b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:52.990288 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-c1a99e25-94ac-4eab-9ab9-59f4f705a60b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:53.007247 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c1a99e25-94ac-4eab-9ab9-59f4f705a60b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:53.007745 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c1a99e25-94ac-4eab-9ab9-59f4f705a60b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:53.008200 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c1a99e25-94ac-4eab-9ab9-59f4f705a60b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:53.009217 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c1a99e25-94ac-4eab-9ab9-59f4f705a60b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:53.009711 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c1a99e25-94ac-4eab-9ab9-59f4f705a60b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:53.010144 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c1a99e25-94ac-4eab-9ab9-59f4f705a60b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:53.050361 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f306c765-6bc0-4fe2-bd56-e94d19160213 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:53.051716 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f306c765-6bc0-4fe2-bd56-e94d19160213 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:53.061147 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f306c765-6bc0-4fe2-bd56-e94d19160213 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:53.065253 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f306c765-6bc0-4fe2-bd56-e94d19160213 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:53.065916 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f306c765-6bc0-4fe2-bd56-e94d19160213 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:53.067091 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f306c765-6bc0-4fe2-bd56-e94d19160213 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:53.067780 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f306c765-6bc0-4fe2-bd56-e94d19160213 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:53.070113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f306c765-6bc0-4fe2-bd56-e94d19160213 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:53.298743 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-c1a99e25-94ac-4eab-9ab9-59f4f705a60b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:53.306161 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f306c765-6bc0-4fe2-bd56-e94d19160213 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:53.309139 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-c1a99e25-94ac-4eab-9ab9-59f4f705a60b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.331375 Sep 02 05:23:53.310543 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 69/144] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:52 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:53.314913 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f306c765-6bc0-4fe2-bd56-e94d19160213 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.269371 Sep 02 05:23:53.315482 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 76/145] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:53 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:53.841911 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ba32ad91-620a-4b17-8b51-25a0247e1a50 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:53.842888 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-ba32ad91-620a-4b17-8b51-25a0247e1a50 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:53.865293 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ba32ad91-620a-4b17-8b51-25a0247e1a50 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:53.865951 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ba32ad91-620a-4b17-8b51-25a0247e1a50 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:53.866532 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ba32ad91-620a-4b17-8b51-25a0247e1a50 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:53.868224 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ba32ad91-620a-4b17-8b51-25a0247e1a50 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:53.869289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ba32ad91-620a-4b17-8b51-25a0247e1a50 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:53.869974 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ba32ad91-620a-4b17-8b51-25a0247e1a50 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:53.928048 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-548db93c-dce2-4e82-b399-be3b69a70ff7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:53.929003 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-548db93c-dce2-4e82-b399-be3b69a70ff7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:53.937484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-548db93c-dce2-4e82-b399-be3b69a70ff7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:53.938281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-548db93c-dce2-4e82-b399-be3b69a70ff7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:53.940049 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-548db93c-dce2-4e82-b399-be3b69a70ff7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:53.941297 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-548db93c-dce2-4e82-b399-be3b69a70ff7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:53.942477 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-548db93c-dce2-4e82-b399-be3b69a70ff7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:53.943138 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-548db93c-dce2-4e82-b399-be3b69a70ff7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:54.141362 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ba32ad91-620a-4b17-8b51-25a0247e1a50 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:54.150318 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-ba32ad91-620a-4b17-8b51-25a0247e1a50 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.312462 Sep 02 05:23:54.155683 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 70/146] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:53 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:23:54.231045 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-548db93c-dce2-4e82-b399-be3b69a70ff7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:54.253117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-548db93c-dce2-4e82-b399-be3b69a70ff7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:54.256015 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-548db93c-dce2-4e82-b399-be3b69a70ff7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:54.264844 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-548db93c-dce2-4e82-b399-be3b69a70ff7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1405 microversion: 2.20 time: 0.337392 Sep 02 05:23:54.266353 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 77/147] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:23:53 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1405 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:23:54.330466 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-70ef1b3e-0e74-4f30-a6f7-abecc8a4fee1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:54.331177 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-70ef1b3e-0e74-4f30-a6f7-abecc8a4fee1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:54.336395 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-15d967a9-4b3c-47e5-b04f-fdbf8b4594c5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:54.337253 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-15d967a9-4b3c-47e5-b04f-fdbf8b4594c5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:54.345017 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-70ef1b3e-0e74-4f30-a6f7-abecc8a4fee1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:54.345298 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-15d967a9-4b3c-47e5-b04f-fdbf8b4594c5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:54.345858 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-15d967a9-4b3c-47e5-b04f-fdbf8b4594c5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:54.346486 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-15d967a9-4b3c-47e5-b04f-fdbf8b4594c5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:54.347881 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-15d967a9-4b3c-47e5-b04f-fdbf8b4594c5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:54.348635 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-70ef1b3e-0e74-4f30-a6f7-abecc8a4fee1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:54.349274 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-70ef1b3e-0e74-4f30-a6f7-abecc8a4fee1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:54.349381 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-15d967a9-4b3c-47e5-b04f-fdbf8b4594c5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:54.349987 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-15d967a9-4b3c-47e5-b04f-fdbf8b4594c5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:54.352216 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-70ef1b3e-0e74-4f30-a6f7-abecc8a4fee1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:54.352875 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-70ef1b3e-0e74-4f30-a6f7-abecc8a4fee1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:54.353369 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-70ef1b3e-0e74-4f30-a6f7-abecc8a4fee1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:54.713942 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-70ef1b3e-0e74-4f30-a6f7-abecc8a4fee1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:54.723556 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-70ef1b3e-0e74-4f30-a6f7-abecc8a4fee1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.396793 Sep 02 05:23:54.725438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-15d967a9-4b3c-47e5-b04f-fdbf8b4594c5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:54.727420 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 71/148] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:54 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:54.735024 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-15d967a9-4b3c-47e5-b04f-fdbf8b4594c5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.404119 Sep 02 05:23:54.752439 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 78/149] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:54 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:23:55.175778 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-95c4f294-b59c-4f23-ae56-be0503bcf3d5 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:55.176431 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-95c4f294-b59c-4f23-ae56-be0503bcf3d5 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:55.188894 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-95c4f294-b59c-4f23-ae56-be0503bcf3d5 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:55.189379 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-95c4f294-b59c-4f23-ae56-be0503bcf3d5 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:55.189810 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-95c4f294-b59c-4f23-ae56-be0503bcf3d5 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:55.190719 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-95c4f294-b59c-4f23-ae56-be0503bcf3d5 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:55.191373 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-95c4f294-b59c-4f23-ae56-be0503bcf3d5 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:55.191955 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-95c4f294-b59c-4f23-ae56-be0503bcf3d5 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:55.287861 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-cde13997-687a-4a3f-b433-67ef2114e6c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:55.288671 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-cde13997-687a-4a3f-b433-67ef2114e6c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:55.297122 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=97 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:55.301521 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cde13997-687a-4a3f-b433-67ef2114e6c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:55.302245 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cde13997-687a-4a3f-b433-67ef2114e6c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:55.302727 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cde13997-687a-4a3f-b433-67ef2114e6c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:55.303444 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cde13997-687a-4a3f-b433-67ef2114e6c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:55.306537 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cde13997-687a-4a3f-b433-67ef2114e6c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:55.307032 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cde13997-687a-4a3f-b433-67ef2114e6c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:55.759109 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-95c4f294-b59c-4f23-ae56-be0503bcf3d5 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:55.765267 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-cde13997-687a-4a3f-b433-67ef2114e6c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:55.770583 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-95c4f294-b59c-4f23-ae56-be0503bcf3d5 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.598631 Sep 02 05:23:55.771161 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 72/150] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:55 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:55.783442 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-cde13997-687a-4a3f-b433-67ef2114e6c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:55.783442 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-cde13997-687a-4a3f-b433-67ef2114e6c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:55.784876 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-cde13997-687a-4a3f-b433-67ef2114e6c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1405 microversion: 2.20 time: 0.501883 Sep 02 05:23:55.786500 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 79/151] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:23:55 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1405 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:23:55.798572 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-1cc56d92-92f8-4c9e-bb0f-1108e080dc2a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:55.799469 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-1cc56d92-92f8-4c9e-bb0f-1108e080dc2a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:55.814625 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d86e932f-9e3f-4c2f-984d-c14fbe71a5b1 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:55.815198 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1cc56d92-92f8-4c9e-bb0f-1108e080dc2a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:55.815317 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-d86e932f-9e3f-4c2f-984d-c14fbe71a5b1 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:55.817127 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1cc56d92-92f8-4c9e-bb0f-1108e080dc2a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:55.817870 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1cc56d92-92f8-4c9e-bb0f-1108e080dc2a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:55.818836 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1cc56d92-92f8-4c9e-bb0f-1108e080dc2a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:55.820349 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1cc56d92-92f8-4c9e-bb0f-1108e080dc2a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:55.820919 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1cc56d92-92f8-4c9e-bb0f-1108e080dc2a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:55.831908 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d86e932f-9e3f-4c2f-984d-c14fbe71a5b1 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:55.832430 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d86e932f-9e3f-4c2f-984d-c14fbe71a5b1 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:55.832864 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d86e932f-9e3f-4c2f-984d-c14fbe71a5b1 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:55.838142 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d86e932f-9e3f-4c2f-984d-c14fbe71a5b1 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:55.838732 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d86e932f-9e3f-4c2f-984d-c14fbe71a5b1 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:55.839176 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d86e932f-9e3f-4c2f-984d-c14fbe71a5b1 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:56.086511 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1cc56d92-92f8-4c9e-bb0f-1108e080dc2a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:56.097367 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-1cc56d92-92f8-4c9e-bb0f-1108e080dc2a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.307986 Sep 02 05:23:56.098150 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 73/152] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:55 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:56.147431 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d86e932f-9e3f-4c2f-984d-c14fbe71a5b1 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:56.161166 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-d86e932f-9e3f-4c2f-984d-c14fbe71a5b1 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.361218 Sep 02 05:23:56.164098 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 80/153] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:55 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:56.791910 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-b9cbe506-16bc-45e3-8477-4952dcd74cab tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:56.792748 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-b9cbe506-16bc-45e3-8477-4952dcd74cab tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:56.807478 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b9cbe506-16bc-45e3-8477-4952dcd74cab tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:56.807775 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b9cbe506-16bc-45e3-8477-4952dcd74cab tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:56.809460 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b9cbe506-16bc-45e3-8477-4952dcd74cab tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:56.811670 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b9cbe506-16bc-45e3-8477-4952dcd74cab tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:56.813122 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b9cbe506-16bc-45e3-8477-4952dcd74cab tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:56.813336 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-8378db7a-885c-48d1-a319-aecb0e8590ba tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:56.813777 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b9cbe506-16bc-45e3-8477-4952dcd74cab tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:56.813925 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-8378db7a-885c-48d1-a319-aecb0e8590ba tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:56.829971 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8378db7a-885c-48d1-a319-aecb0e8590ba tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:56.833025 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8378db7a-885c-48d1-a319-aecb0e8590ba tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:56.833676 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8378db7a-885c-48d1-a319-aecb0e8590ba tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:56.839748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8378db7a-885c-48d1-a319-aecb0e8590ba tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:56.840593 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8378db7a-885c-48d1-a319-aecb0e8590ba tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:56.842529 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8378db7a-885c-48d1-a319-aecb0e8590ba tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:57.164923 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-b9cbe506-16bc-45e3-8477-4952dcd74cab tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:57.196228 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-b9cbe506-16bc-45e3-8477-4952dcd74cab tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.406450 Sep 02 05:23:57.196972 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 74/154] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:56 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:57.236170 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-8378db7a-885c-48d1-a319-aecb0e8590ba tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:57.247701 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-8378db7a-885c-48d1-a319-aecb0e8590ba tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:57.249494 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-8378db7a-885c-48d1-a319-aecb0e8590ba tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:57.251401 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-8378db7a-885c-48d1-a319-aecb0e8590ba tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1405 microversion: 2.20 time: 0.442590 Sep 02 05:23:57.252560 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 81/155] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:23:56 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1405 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:23:57.258559 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-79754a80-6a3c-4a82-8a10-4c993d9352fa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:57.259357 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-79754a80-6a3c-4a82-8a10-4c993d9352fa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:57.268184 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-79754a80-6a3c-4a82-8a10-4c993d9352fa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:57.268950 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-79754a80-6a3c-4a82-8a10-4c993d9352fa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:57.269631 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-79754a80-6a3c-4a82-8a10-4c993d9352fa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:57.270327 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-79754a80-6a3c-4a82-8a10-4c993d9352fa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:57.270833 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-79754a80-6a3c-4a82-8a10-4c993d9352fa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:57.271297 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-79754a80-6a3c-4a82-8a10-4c993d9352fa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:57.418399 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-4c7bc9d3-11d8-4f8f-8804-96a128356ad7 req-735f092b-e959-452d-8e1a-e4fe5ed0288f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67493ca3-e212-45fa-886f-5c2bc5239f0b", "name": "network-vif-plugged", "status": "completed", "tag": "0744525a-63a3-4a71-a8c1-440cbf4eccd2"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:23:57.434031 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-4c7bc9d3-11d8-4f8f-8804-96a128356ad7 req-735f092b-e959-452d-8e1a-e4fe5ed0288f service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:57.434700 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-4c7bc9d3-11d8-4f8f-8804-96a128356ad7 req-735f092b-e959-452d-8e1a-e4fe5ed0288f service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:57.435527 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-4c7bc9d3-11d8-4f8f-8804-96a128356ad7 req-735f092b-e959-452d-8e1a-e4fe5ed0288f service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:57.451907 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-79754a80-6a3c-4a82-8a10-4c993d9352fa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:57.456038 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-4c7bc9d3-11d8-4f8f-8804-96a128356ad7 req-735f092b-e959-452d-8e1a-e4fe5ed0288f service nova] Creating event network-vif-plugged:0744525a-63a3-4a71-a8c1-440cbf4eccd2 for instance 67493ca3-e212-45fa-886f-5c2bc5239f0b on hv-cinder-85391 Sep 02 05:23:57.459819 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-79754a80-6a3c-4a82-8a10-4c993d9352fa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.205614 Sep 02 05:23:57.460434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 82/156] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:57 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:57.462093 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-4c7bc9d3-11d8-4f8f-8804-96a128356ad7 req-735f092b-e959-452d-8e1a-e4fe5ed0288f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.263958 Sep 02 05:23:57.466376 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 75/157] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:23:57.468164 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-011f2081-8952-49b4-abc9-2a513a0798ae tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:57.469984 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-011f2081-8952-49b4-abc9-2a513a0798ae tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:57.482685 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-011f2081-8952-49b4-abc9-2a513a0798ae tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:57.483408 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-011f2081-8952-49b4-abc9-2a513a0798ae tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:57.485825 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-011f2081-8952-49b4-abc9-2a513a0798ae tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:57.486979 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-011f2081-8952-49b4-abc9-2a513a0798ae tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:57.487891 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-011f2081-8952-49b4-abc9-2a513a0798ae tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:57.488765 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-011f2081-8952-49b4-abc9-2a513a0798ae tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:57.673984 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-011f2081-8952-49b4-abc9-2a513a0798ae tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:57.687267 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-011f2081-8952-49b4-abc9-2a513a0798ae tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.223792 Sep 02 05:23:57.688614 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 83/158] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:57 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:58.220372 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-7e766581-99ce-4afe-a345-c1de34311aa5 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:58.221054 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-7e766581-99ce-4afe-a345-c1de34311aa5 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:58.227309 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7e766581-99ce-4afe-a345-c1de34311aa5 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:58.228094 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7e766581-99ce-4afe-a345-c1de34311aa5 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:58.228754 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7e766581-99ce-4afe-a345-c1de34311aa5 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:58.238400 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7e766581-99ce-4afe-a345-c1de34311aa5 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:58.238872 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7e766581-99ce-4afe-a345-c1de34311aa5 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:58.239297 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7e766581-99ce-4afe-a345-c1de34311aa5 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:58.267913 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell0:SELECT=2 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:58.277171 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-a8da9544-8b97-4826-95f5-da29135e1429 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:58.277765 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-a8da9544-8b97-4826-95f5-da29135e1429 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:58.286012 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a8da9544-8b97-4826-95f5-da29135e1429 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:58.286656 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a8da9544-8b97-4826-95f5-da29135e1429 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:58.287229 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a8da9544-8b97-4826-95f5-da29135e1429 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:58.288064 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a8da9544-8b97-4826-95f5-da29135e1429 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:58.288693 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a8da9544-8b97-4826-95f5-da29135e1429 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:58.289249 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a8da9544-8b97-4826-95f5-da29135e1429 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:58.439707 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-7e766581-99ce-4afe-a345-c1de34311aa5 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:58.450661 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-7e766581-99ce-4afe-a345-c1de34311aa5 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.234287 Sep 02 05:23:58.452160 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 76/159] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:58 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:58.459908 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-3d3bda6b-a1b9-4d25-bbd4-c46f9549f470 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-823142123", "imageRef": "f3669111-2e3f-4f39-878f-19d263505eaa", "flavorRef": "452", "networks": [{"uuid": "6129eeca-b362-47ba-b416-329cd7e4324d"}]}} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:23:58.477806 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-a8da9544-8b97-4826-95f5-da29135e1429 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:58.486916 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-a8da9544-8b97-4826-95f5-da29135e1429 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:58.488363 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-a8da9544-8b97-4826-95f5-da29135e1429 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:58.489461 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-a8da9544-8b97-4826-95f5-da29135e1429 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1405 microversion: 2.20 time: 0.216175 Sep 02 05:23:58.490007 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 84/160] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:23:58 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1405 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:23:58.494906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-8e1fecdc-c5df-4cbc-9abf-2bd76cf9533c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:58.495494 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-8e1fecdc-c5df-4cbc-9abf-2bd76cf9533c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:58.501460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8e1fecdc-c5df-4cbc-9abf-2bd76cf9533c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:58.502122 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8e1fecdc-c5df-4cbc-9abf-2bd76cf9533c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:58.502698 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8e1fecdc-c5df-4cbc-9abf-2bd76cf9533c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:58.503375 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8e1fecdc-c5df-4cbc-9abf-2bd76cf9533c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:58.503815 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8e1fecdc-c5df-4cbc-9abf-2bd76cf9533c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:58.504266 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8e1fecdc-c5df-4cbc-9abf-2bd76cf9533c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:58.543693 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.network.neutron [None req-3d3bda6b-a1b9-4d25-bbd4-c46f9549f470 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] validate_networks() for [('6129eeca-b362-47ba-b416-329cd7e4324d', None, None, None, None, None)] {{(pid=120449) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 05:23:58.723462 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-8e1fecdc-c5df-4cbc-9abf-2bd76cf9533c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:58.732014 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-8e1fecdc-c5df-4cbc-9abf-2bd76cf9533c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.240652 Sep 02 05:23:58.733152 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 85/161] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:58 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:58.739407 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-734955fa-7667-4044-9a78-3bc129212252 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:58.740230 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-734955fa-7667-4044-9a78-3bc129212252 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:58.752685 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-734955fa-7667-4044-9a78-3bc129212252 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:58.753566 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-734955fa-7667-4044-9a78-3bc129212252 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:58.754122 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-734955fa-7667-4044-9a78-3bc129212252 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:58.754772 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-734955fa-7667-4044-9a78-3bc129212252 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:58.755237 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-734955fa-7667-4044-9a78-3bc129212252 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:58.755662 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-734955fa-7667-4044-9a78-3bc129212252 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:58.985555 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-734955fa-7667-4044-9a78-3bc129212252 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:58.995033 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-734955fa-7667-4044-9a78-3bc129212252 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.260245 Sep 02 05:23:58.996642 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 86/162] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:58 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:59.079378 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.virt.hardware [None req-3d3bda6b-a1b9-4d25-bbd4-c46f9549f470 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Flavor limits 0:0:0 {{(pid=120449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 05:23:59.079810 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.virt.hardware [None req-3d3bda6b-a1b9-4d25-bbd4-c46f9549f470 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Image limits 0:0:0 {{(pid=120449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 05:23:59.080312 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.virt.hardware [None req-3d3bda6b-a1b9-4d25-bbd4-c46f9549f470 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Flavor pref 0:0:0 {{(pid=120449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 05:23:59.080900 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.virt.hardware [None req-3d3bda6b-a1b9-4d25-bbd4-c46f9549f470 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Image pref 0:0:0 {{(pid=120449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 05:23:59.081445 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.virt.hardware [None req-3d3bda6b-a1b9-4d25-bbd4-c46f9549f470 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 05:23:59.091085 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3d3bda6b-a1b9-4d25-bbd4-c46f9549f470 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:59.091804 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3d3bda6b-a1b9-4d25-bbd4-c46f9549f470 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:59.092545 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3d3bda6b-a1b9-4d25-bbd4-c46f9549f470 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:59.093402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3d3bda6b-a1b9-4d25-bbd4-c46f9549f470 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:59.093839 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3d3bda6b-a1b9-4d25-bbd4-c46f9549f470 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:59.094487 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3d3bda6b-a1b9-4d25-bbd4-c46f9549f470 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:59.119784 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.quota [None req-3d3bda6b-a1b9-4d25-bbd4-c46f9549f470 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Getting quotas for project 179a293b863c45bfa9642ec75a94b824. Resources: {'ram', 'instances', 'cores'} {{(pid=120449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:23:59.124437 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.quota [None req-3d3bda6b-a1b9-4d25-bbd4-c46f9549f470 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Getting quotas for user a007e2f923f142f8a82e8a976a8e660f and project 179a293b863c45bfa9642ec75a94b824. Resources: {'ram', 'instances', 'cores'} {{(pid=120449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:23:59.136540 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-3d3bda6b-a1b9-4d25-bbd4-c46f9549f470 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Going to run 1 instances... {{(pid=120449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 05:23:59.138835 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-3d3bda6b-a1b9-4d25-bbd4-c46f9549f470 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3669111-2e3f-4f39-878f-19d263505eaa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 05:23:59.189770 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-3d3bda6b-a1b9-4d25-bbd4-c46f9549f470 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.735699 Sep 02 05:23:59.191202 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 77/163] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Sep 2 05:23:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 05:23:59.203533 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-058f3e8a-4045-4549-9e04-be09f9a7c61e tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:59.204107 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-058f3e8a-4045-4549-9e04-be09f9a7c61e tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:59.287165 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-058f3e8a-4045-4549-9e04-be09f9a7c61e tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:59.296299 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-058f3e8a-4045-4549-9e04-be09f9a7c61e tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1213 microversion: 2.1 time: 0.097740 Sep 02 05:23:59.297088 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 87/164] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:59 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1213 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:23:59.472078 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-f692bea9-e883-47d5-8e72-c1a1600d5d80 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:59.472709 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-f692bea9-e883-47d5-8e72-c1a1600d5d80 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:59.483331 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f692bea9-e883-47d5-8e72-c1a1600d5d80 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:59.484709 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f692bea9-e883-47d5-8e72-c1a1600d5d80 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:59.485400 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f692bea9-e883-47d5-8e72-c1a1600d5d80 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:59.486641 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f692bea9-e883-47d5-8e72-c1a1600d5d80 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:59.487940 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f692bea9-e883-47d5-8e72-c1a1600d5d80 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:59.488574 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f692bea9-e883-47d5-8e72-c1a1600d5d80 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:59.523294 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-e76e42bb-94b8-4238-910e-9f4e99be7652 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:59.529660 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-e76e42bb-94b8-4238-910e-9f4e99be7652 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:59.542484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e76e42bb-94b8-4238-910e-9f4e99be7652 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:59.545658 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e76e42bb-94b8-4238-910e-9f4e99be7652 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:59.546168 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e76e42bb-94b8-4238-910e-9f4e99be7652 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:59.547741 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e76e42bb-94b8-4238-910e-9f4e99be7652 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:59.553228 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e76e42bb-94b8-4238-910e-9f4e99be7652 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:59.553750 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e76e42bb-94b8-4238-910e-9f4e99be7652 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:59.725605 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-f692bea9-e883-47d5-8e72-c1a1600d5d80 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:59.733868 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-f692bea9-e883-47d5-8e72-c1a1600d5d80 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.265574 Sep 02 05:23:59.734432 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 78/165] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:59 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:23:59.753270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5f3619f0-5143-4c5f-9f03-cdadb4af1770 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:23:59.753956 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5f3619f0-5143-4c5f-9f03-cdadb4af1770 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:23:59.765265 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5f3619f0-5143-4c5f-9f03-cdadb4af1770 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:59.766253 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5f3619f0-5143-4c5f-9f03-cdadb4af1770 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:59.766688 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5f3619f0-5143-4c5f-9f03-cdadb4af1770 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:59.767932 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5f3619f0-5143-4c5f-9f03-cdadb4af1770 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:23:59.768420 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5f3619f0-5143-4c5f-9f03-cdadb4af1770 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:23:59.768839 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5f3619f0-5143-4c5f-9f03-cdadb4af1770 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:23:59.820653 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-e76e42bb-94b8-4238-910e-9f4e99be7652 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:59.824219 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=100 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:59.830401 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-e76e42bb-94b8-4238-910e-9f4e99be7652 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:59.831855 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-e76e42bb-94b8-4238-910e-9f4e99be7652 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:59.832992 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-e76e42bb-94b8-4238-910e-9f4e99be7652 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1405 microversion: 2.20 time: 0.322632 Sep 02 05:23:59.833547 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 88/166] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:23:59 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1405 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:23:59.942926 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5f3619f0-5143-4c5f-9f03-cdadb4af1770 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:23:59.950551 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5f3619f0-5143-4c5f-9f03-cdadb4af1770 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.201653 Sep 02 05:23:59.951281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 79/167] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:23:59 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:00.017493 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-fe305c52-58d0-4147-b4d1-4729087dd2a4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:00.018149 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-fe305c52-58d0-4147-b4d1-4729087dd2a4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:00.024704 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fe305c52-58d0-4147-b4d1-4729087dd2a4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:00.025547 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fe305c52-58d0-4147-b4d1-4729087dd2a4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:00.026167 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fe305c52-58d0-4147-b4d1-4729087dd2a4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:00.027505 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fe305c52-58d0-4147-b4d1-4729087dd2a4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:00.028185 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fe305c52-58d0-4147-b4d1-4729087dd2a4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:00.028781 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fe305c52-58d0-4147-b4d1-4729087dd2a4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:00.175596 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-fe305c52-58d0-4147-b4d1-4729087dd2a4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:00.183771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-fe305c52-58d0-4147-b4d1-4729087dd2a4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.171663 Sep 02 05:24:00.184592 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 89/168] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:00 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:00.324459 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ec1fce59-dd7d-48f2-bc2b-d2cd9338f8d5 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:00.325254 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-ec1fce59-dd7d-48f2-bc2b-d2cd9338f8d5 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:00.332770 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ec1fce59-dd7d-48f2-bc2b-d2cd9338f8d5 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:00.333383 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ec1fce59-dd7d-48f2-bc2b-d2cd9338f8d5 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:00.334042 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ec1fce59-dd7d-48f2-bc2b-d2cd9338f8d5 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:00.334978 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ec1fce59-dd7d-48f2-bc2b-d2cd9338f8d5 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:00.335527 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ec1fce59-dd7d-48f2-bc2b-d2cd9338f8d5 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:00.336147 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ec1fce59-dd7d-48f2-bc2b-d2cd9338f8d5 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:00.408371 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ec1fce59-dd7d-48f2-bc2b-d2cd9338f8d5 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:00.417168 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-ec1fce59-dd7d-48f2-bc2b-d2cd9338f8d5 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1217 microversion: 2.1 time: 0.097112 Sep 02 05:24:00.418162 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 80/169] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:00 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:00.757639 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-0201564c-c624-4d5c-8c3a-a878d528eaae tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:00.758239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-0201564c-c624-4d5c-8c3a-a878d528eaae tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:00.764315 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0201564c-c624-4d5c-8c3a-a878d528eaae tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:00.764788 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0201564c-c624-4d5c-8c3a-a878d528eaae tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:00.765208 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0201564c-c624-4d5c-8c3a-a878d528eaae tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:00.765879 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0201564c-c624-4d5c-8c3a-a878d528eaae tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:00.766344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0201564c-c624-4d5c-8c3a-a878d528eaae tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:00.766742 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0201564c-c624-4d5c-8c3a-a878d528eaae tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:00.857926 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ad7265b4-c9c7-4584-9bd5-693b845b0261 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:00.858523 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-ad7265b4-c9c7-4584-9bd5-693b845b0261 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:00.871518 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ad7265b4-c9c7-4584-9bd5-693b845b0261 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:00.872003 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ad7265b4-c9c7-4584-9bd5-693b845b0261 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:00.872679 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ad7265b4-c9c7-4584-9bd5-693b845b0261 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:00.873592 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ad7265b4-c9c7-4584-9bd5-693b845b0261 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:00.874038 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ad7265b4-c9c7-4584-9bd5-693b845b0261 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:00.874442 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ad7265b4-c9c7-4584-9bd5-693b845b0261 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:00.902102 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-0201564c-c624-4d5c-8c3a-a878d528eaae tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:00.911120 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-0201564c-c624-4d5c-8c3a-a878d528eaae tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.157263 Sep 02 05:24:00.922578 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 90/170] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:00 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:00.971808 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-9b94d101-934d-4e17-99b8-1ef1bd089d5f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:00.972619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-9b94d101-934d-4e17-99b8-1ef1bd089d5f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:00.979341 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9b94d101-934d-4e17-99b8-1ef1bd089d5f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:00.979824 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9b94d101-934d-4e17-99b8-1ef1bd089d5f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:00.980369 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9b94d101-934d-4e17-99b8-1ef1bd089d5f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:00.981350 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9b94d101-934d-4e17-99b8-1ef1bd089d5f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:00.981956 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9b94d101-934d-4e17-99b8-1ef1bd089d5f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:00.982382 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9b94d101-934d-4e17-99b8-1ef1bd089d5f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:01.004890 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ad7265b4-c9c7-4584-9bd5-693b845b0261 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:01.013223 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ad7265b4-c9c7-4584-9bd5-693b845b0261 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:01.014674 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ad7265b4-c9c7-4584-9bd5-693b845b0261 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:01.015749 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-ad7265b4-c9c7-4584-9bd5-693b845b0261 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1405 microversion: 2.20 time: 0.164861 Sep 02 05:24:01.016521 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 81/171] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:24:00 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:24:01.111900 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-9b94d101-934d-4e17-99b8-1ef1bd089d5f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:01.120791 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-9b94d101-934d-4e17-99b8-1ef1bd089d5f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.153635 Sep 02 05:24:01.121516 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 91/172] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:00 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:01.205857 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-b288f1ef-9cbe-4ce8-809d-422a708c7b28 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:01.207125 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-b288f1ef-9cbe-4ce8-809d-422a708c7b28 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:01.209267 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:01.214652 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b288f1ef-9cbe-4ce8-809d-422a708c7b28 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:01.215144 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b288f1ef-9cbe-4ce8-809d-422a708c7b28 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:01.215571 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b288f1ef-9cbe-4ce8-809d-422a708c7b28 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:01.216277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b288f1ef-9cbe-4ce8-809d-422a708c7b28 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:01.216743 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b288f1ef-9cbe-4ce8-809d-422a708c7b28 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:01.217164 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b288f1ef-9cbe-4ce8-809d-422a708c7b28 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:01.343466 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-b288f1ef-9cbe-4ce8-809d-422a708c7b28 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:01.352210 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-b288f1ef-9cbe-4ce8-809d-422a708c7b28 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.150997 Sep 02 05:24:01.352783 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 82/173] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:01 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:01.438461 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-159994e0-d333-41e1-a6de-786f93f380de tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:01.439098 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-159994e0-d333-41e1-a6de-786f93f380de tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:01.444929 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-159994e0-d333-41e1-a6de-786f93f380de tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:01.445402 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-159994e0-d333-41e1-a6de-786f93f380de tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:01.445825 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-159994e0-d333-41e1-a6de-786f93f380de tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:01.446492 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-159994e0-d333-41e1-a6de-786f93f380de tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:01.446931 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-159994e0-d333-41e1-a6de-786f93f380de tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:01.447342 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-159994e0-d333-41e1-a6de-786f93f380de tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:01.506600 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-159994e0-d333-41e1-a6de-786f93f380de tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:01.514290 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-159994e0-d333-41e1-a6de-786f93f380de tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1217 microversion: 2.1 time: 0.080298 Sep 02 05:24:01.514845 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 92/174] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:01 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:01.932420 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5fc74a8e-e4eb-4a79-9b63-c8efc0befa9f tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:01.933033 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5fc74a8e-e4eb-4a79-9b63-c8efc0befa9f tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:01.939255 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5fc74a8e-e4eb-4a79-9b63-c8efc0befa9f tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:01.939706 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5fc74a8e-e4eb-4a79-9b63-c8efc0befa9f tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:01.940156 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5fc74a8e-e4eb-4a79-9b63-c8efc0befa9f tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:01.940860 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5fc74a8e-e4eb-4a79-9b63-c8efc0befa9f tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:01.941289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5fc74a8e-e4eb-4a79-9b63-c8efc0befa9f tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:01.941717 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5fc74a8e-e4eb-4a79-9b63-c8efc0befa9f tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:02.038831 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-34056e48-e05a-450e-a76d-337df522e0fa tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:02.040654 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-34056e48-e05a-450e-a76d-337df522e0fa tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:02.047000 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-34056e48-e05a-450e-a76d-337df522e0fa tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:02.047676 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-34056e48-e05a-450e-a76d-337df522e0fa tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:02.048529 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-34056e48-e05a-450e-a76d-337df522e0fa tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:02.049202 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-34056e48-e05a-450e-a76d-337df522e0fa tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:02.049923 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-34056e48-e05a-450e-a76d-337df522e0fa tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:02.050764 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-34056e48-e05a-450e-a76d-337df522e0fa tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:02.076679 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5fc74a8e-e4eb-4a79-9b63-c8efc0befa9f tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:02.084806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5fc74a8e-e4eb-4a79-9b63-c8efc0befa9f tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.156213 Sep 02 05:24:02.085482 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 83/175] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:01 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:02.142296 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-8038be51-6a81-45db-945a-ae28d64c9702 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:02.142900 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-8038be51-6a81-45db-945a-ae28d64c9702 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:02.153217 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8038be51-6a81-45db-945a-ae28d64c9702 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:02.153710 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8038be51-6a81-45db-945a-ae28d64c9702 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:02.156063 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8038be51-6a81-45db-945a-ae28d64c9702 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:02.160886 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8038be51-6a81-45db-945a-ae28d64c9702 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:02.161661 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8038be51-6a81-45db-945a-ae28d64c9702 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:02.162228 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8038be51-6a81-45db-945a-ae28d64c9702 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:02.200412 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-34056e48-e05a-450e-a76d-337df522e0fa tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:02.203460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-34056e48-e05a-450e-a76d-337df522e0fa tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:02.205849 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-34056e48-e05a-450e-a76d-337df522e0fa tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:02.207633 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-34056e48-e05a-450e-a76d-337df522e0fa tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1405 microversion: 2.20 time: 0.173434 Sep 02 05:24:02.208226 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 93/176] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:24:02 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:24:02.313948 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-8038be51-6a81-45db-945a-ae28d64c9702 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:02.317438 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=100 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:02.321984 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-8038be51-6a81-45db-945a-ae28d64c9702 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.184229 Sep 02 05:24:02.322524 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 84/177] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:02 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:24:02.373494 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-37815373-5c23-48e1-986e-b7279087c32f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:02.374184 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-37815373-5c23-48e1-986e-b7279087c32f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:02.380161 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-37815373-5c23-48e1-986e-b7279087c32f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:02.380631 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-37815373-5c23-48e1-986e-b7279087c32f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:02.381058 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-37815373-5c23-48e1-986e-b7279087c32f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:02.381729 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-37815373-5c23-48e1-986e-b7279087c32f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:02.382178 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-37815373-5c23-48e1-986e-b7279087c32f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:02.382589 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-37815373-5c23-48e1-986e-b7279087c32f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:02.514633 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-37815373-5c23-48e1-986e-b7279087c32f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:02.522470 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-37815373-5c23-48e1-986e-b7279087c32f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.152914 Sep 02 05:24:02.523031 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 94/178] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:02 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:02.535535 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-a0a6a8ba-0424-4103-b9e8-7cf4903755bf req-b246e585-b78a-46f3-9cbc-df5123f4af1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ca0f78c-4691-4690-8772-c9fd6cfde418", "name": "network-vif-plugged", "status": "completed", "tag": "e4be745a-a91e-4f61-b12b-42bd38befb73"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:24:02.546049 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-a0a6a8ba-0424-4103-b9e8-7cf4903755bf req-b246e585-b78a-46f3-9cbc-df5123f4af1a service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:02.546698 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-a0a6a8ba-0424-4103-b9e8-7cf4903755bf req-b246e585-b78a-46f3-9cbc-df5123f4af1a service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:02.546834 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d6c3d95c-dc03-4537-92e4-9ac1e0ec8dc3 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:02.547282 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-a0a6a8ba-0424-4103-b9e8-7cf4903755bf req-b246e585-b78a-46f3-9cbc-df5123f4af1a service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:02.547407 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-d6c3d95c-dc03-4537-92e4-9ac1e0ec8dc3 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:02.555820 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d6c3d95c-dc03-4537-92e4-9ac1e0ec8dc3 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:02.556501 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d6c3d95c-dc03-4537-92e4-9ac1e0ec8dc3 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:02.557200 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d6c3d95c-dc03-4537-92e4-9ac1e0ec8dc3 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:02.558868 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d6c3d95c-dc03-4537-92e4-9ac1e0ec8dc3 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:02.559541 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d6c3d95c-dc03-4537-92e4-9ac1e0ec8dc3 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:02.560169 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d6c3d95c-dc03-4537-92e4-9ac1e0ec8dc3 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:02.561569 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-a0a6a8ba-0424-4103-b9e8-7cf4903755bf req-b246e585-b78a-46f3-9cbc-df5123f4af1a service nova] Creating event network-vif-plugged:e4be745a-a91e-4f61-b12b-42bd38befb73 for instance 7ca0f78c-4691-4690-8772-c9fd6cfde418 on hv-cinder-85391 Sep 02 05:24:02.567176 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-a0a6a8ba-0424-4103-b9e8-7cf4903755bf req-b246e585-b78a-46f3-9cbc-df5123f4af1a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036866 Sep 02 05:24:02.567761 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 85/179] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:24:02.626360 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d6c3d95c-dc03-4537-92e4-9ac1e0ec8dc3 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:02.634021 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-d6c3d95c-dc03-4537-92e4-9ac1e0ec8dc3 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1217 microversion: 2.1 time: 0.091181 Sep 02 05:24:02.634476 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 95/180] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:02 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:03.107218 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-dbfa2c9e-945a-41be-a77a-057b13de1c81 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:03.107915 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-dbfa2c9e-945a-41be-a77a-057b13de1c81 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:03.114327 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dbfa2c9e-945a-41be-a77a-057b13de1c81 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:03.114808 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dbfa2c9e-945a-41be-a77a-057b13de1c81 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:03.115236 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dbfa2c9e-945a-41be-a77a-057b13de1c81 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:03.115915 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dbfa2c9e-945a-41be-a77a-057b13de1c81 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:03.116400 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dbfa2c9e-945a-41be-a77a-057b13de1c81 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:03.116856 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dbfa2c9e-945a-41be-a77a-057b13de1c81 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:03.231433 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-4b9ffa93-928a-424c-8577-3b093d6111ce tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:03.232380 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-4b9ffa93-928a-424c-8577-3b093d6111ce tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:03.239189 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4b9ffa93-928a-424c-8577-3b093d6111ce tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:03.239810 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4b9ffa93-928a-424c-8577-3b093d6111ce tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:03.240372 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4b9ffa93-928a-424c-8577-3b093d6111ce tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:03.241183 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4b9ffa93-928a-424c-8577-3b093d6111ce tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:03.241917 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4b9ffa93-928a-424c-8577-3b093d6111ce tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:03.242484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4b9ffa93-928a-424c-8577-3b093d6111ce tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:03.494804 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-dbfa2c9e-945a-41be-a77a-057b13de1c81 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:03.502306 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-4b9ffa93-928a-424c-8577-3b093d6111ce tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:03.503369 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-dbfa2c9e-945a-41be-a77a-057b13de1c81 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.400414 Sep 02 05:24:03.504007 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 86/181] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:03 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:03.508711 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-aa1452a1-7c59-49a2-93ad-c3195b6e22ff tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:03.509523 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-aa1452a1-7c59-49a2-93ad-c3195b6e22ff tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:03.510219 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-4b9ffa93-928a-424c-8577-3b093d6111ce tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:03.511745 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-4b9ffa93-928a-424c-8577-3b093d6111ce tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:03.512872 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-4b9ffa93-928a-424c-8577-3b093d6111ce tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1405 microversion: 2.20 time: 0.285788 Sep 02 05:24:03.513417 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 96/182] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:24:03 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1405 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:24:03.518037 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-aa1452a1-7c59-49a2-93ad-c3195b6e22ff tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:03.518643 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-aa1452a1-7c59-49a2-93ad-c3195b6e22ff tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:03.519200 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-aa1452a1-7c59-49a2-93ad-c3195b6e22ff tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:03.519978 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-aa1452a1-7c59-49a2-93ad-c3195b6e22ff tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:03.520559 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-aa1452a1-7c59-49a2-93ad-c3195b6e22ff tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:03.521074 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-aa1452a1-7c59-49a2-93ad-c3195b6e22ff tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:03.542690 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-2274cd50-9d69-4309-9c09-cb7389f7f614 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:03.547923 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-2274cd50-9d69-4309-9c09-cb7389f7f614 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:03.554183 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2274cd50-9d69-4309-9c09-cb7389f7f614 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:03.554736 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2274cd50-9d69-4309-9c09-cb7389f7f614 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:03.555253 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2274cd50-9d69-4309-9c09-cb7389f7f614 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:03.556146 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2274cd50-9d69-4309-9c09-cb7389f7f614 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:03.556669 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2274cd50-9d69-4309-9c09-cb7389f7f614 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:03.557155 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2274cd50-9d69-4309-9c09-cb7389f7f614 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:03.721595 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-aa1452a1-7c59-49a2-93ad-c3195b6e22ff tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:03.729122 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-aa1452a1-7c59-49a2-93ad-c3195b6e22ff tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.223900 Sep 02 05:24:03.730021 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 87/183] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:03 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:03.732498 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-2274cd50-9d69-4309-9c09-cb7389f7f614 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:03.740147 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-2274cd50-9d69-4309-9c09-cb7389f7f614 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.201219 Sep 02 05:24:03.740930 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 97/184] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:03 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:03.745233 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-e535174b-68f1-4599-bbfe-7543f71823db tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:03.746005 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-e535174b-68f1-4599-bbfe-7543f71823db tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:03.751872 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e535174b-68f1-4599-bbfe-7543f71823db tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:03.752371 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e535174b-68f1-4599-bbfe-7543f71823db tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:03.752797 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e535174b-68f1-4599-bbfe-7543f71823db tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:03.753470 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e535174b-68f1-4599-bbfe-7543f71823db tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:03.753914 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e535174b-68f1-4599-bbfe-7543f71823db tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:03.754327 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e535174b-68f1-4599-bbfe-7543f71823db tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:03.821004 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e535174b-68f1-4599-bbfe-7543f71823db tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:03.828980 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-e535174b-68f1-4599-bbfe-7543f71823db tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1217 microversion: 2.1 time: 0.087728 Sep 02 05:24:03.829521 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 88/185] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:03 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:04.524283 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-35d618b5-650f-4dce-9775-a813bde7a20c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:04.524803 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-35d618b5-650f-4dce-9775-a813bde7a20c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:04.531164 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-35d618b5-650f-4dce-9775-a813bde7a20c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:04.531642 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-35d618b5-650f-4dce-9775-a813bde7a20c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:04.532047 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-35d618b5-650f-4dce-9775-a813bde7a20c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:04.532789 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-35d618b5-650f-4dce-9775-a813bde7a20c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:04.533237 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-35d618b5-650f-4dce-9775-a813bde7a20c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:04.533655 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-35d618b5-650f-4dce-9775-a813bde7a20c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:04.534434 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-64ebf248-7f2b-4b3b-b1b7-911e788bdf07 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:04.535115 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-64ebf248-7f2b-4b3b-b1b7-911e788bdf07 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:04.541299 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-64ebf248-7f2b-4b3b-b1b7-911e788bdf07 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:04.541799 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-64ebf248-7f2b-4b3b-b1b7-911e788bdf07 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:04.542258 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-64ebf248-7f2b-4b3b-b1b7-911e788bdf07 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:04.542961 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-64ebf248-7f2b-4b3b-b1b7-911e788bdf07 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:04.543447 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-64ebf248-7f2b-4b3b-b1b7-911e788bdf07 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:04.543869 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-64ebf248-7f2b-4b3b-b1b7-911e788bdf07 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:04.720149 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-35d618b5-650f-4dce-9775-a813bde7a20c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:04.724686 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-64ebf248-7f2b-4b3b-b1b7-911e788bdf07 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:04.730289 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-35d618b5-650f-4dce-9775-a813bde7a20c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.209760 Sep 02 05:24:04.730837 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 98/186] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:04 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:04.736092 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-64ebf248-7f2b-4b3b-b1b7-911e788bdf07 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:04.737602 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-64ebf248-7f2b-4b3b-b1b7-911e788bdf07 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:04.738704 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-64ebf248-7f2b-4b3b-b1b7-911e788bdf07 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1405 microversion: 2.20 time: 0.208398 Sep 02 05:24:04.739415 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 89/187] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:24:04 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1405 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:24:04.751552 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-67e9280c-531a-4ba0-9d04-f1eb69262793 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:04.752334 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-67e9280c-531a-4ba0-9d04-f1eb69262793 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:04.759345 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-67e9280c-531a-4ba0-9d04-f1eb69262793 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:04.759941 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-67e9280c-531a-4ba0-9d04-f1eb69262793 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:04.760493 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-67e9280c-531a-4ba0-9d04-f1eb69262793 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:04.761568 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-458ef002-9a29-46c4-99f1-93abd8bf4b6d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:04.761665 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-67e9280c-531a-4ba0-9d04-f1eb69262793 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:04.761953 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-458ef002-9a29-46c4-99f1-93abd8bf4b6d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:04.762069 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-67e9280c-531a-4ba0-9d04-f1eb69262793 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:04.762524 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-67e9280c-531a-4ba0-9d04-f1eb69262793 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:04.768365 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-458ef002-9a29-46c4-99f1-93abd8bf4b6d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:04.768875 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-458ef002-9a29-46c4-99f1-93abd8bf4b6d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:04.769350 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-458ef002-9a29-46c4-99f1-93abd8bf4b6d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:04.770082 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-458ef002-9a29-46c4-99f1-93abd8bf4b6d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:04.770553 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-458ef002-9a29-46c4-99f1-93abd8bf4b6d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:04.770973 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-458ef002-9a29-46c4-99f1-93abd8bf4b6d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:04.951944 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-67e9280c-531a-4ba0-9d04-f1eb69262793 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:04.956678 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-458ef002-9a29-46c4-99f1-93abd8bf4b6d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:04.963320 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-67e9280c-531a-4ba0-9d04-f1eb69262793 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.216713 Sep 02 05:24:04.964167 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 99/188] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:04 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:04.967242 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-458ef002-9a29-46c4-99f1-93abd8bf4b6d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.210200 Sep 02 05:24:04.967973 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 90/189] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:04 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:24:04.968505 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-7bf6ea89-2283-4ef6-a773-939b71d3eca8 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:04.969121 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-7bf6ea89-2283-4ef6-a773-939b71d3eca8 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:04.975647 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7bf6ea89-2283-4ef6-a773-939b71d3eca8 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:04.976262 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7bf6ea89-2283-4ef6-a773-939b71d3eca8 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:04.976762 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7bf6ea89-2283-4ef6-a773-939b71d3eca8 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:04.977572 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7bf6ea89-2283-4ef6-a773-939b71d3eca8 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:04.978003 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7bf6ea89-2283-4ef6-a773-939b71d3eca8 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:04.978440 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7bf6ea89-2283-4ef6-a773-939b71d3eca8 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:05.039973 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-7bf6ea89-2283-4ef6-a773-939b71d3eca8 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:05.048097 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-7bf6ea89-2283-4ef6-a773-939b71d3eca8 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1217 microversion: 2.1 time: 0.082999 Sep 02 05:24:05.048696 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 100/190] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:04 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:05.751123 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-b1c7e9c5-0ced-4bdf-8239-27bf296e411e tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:05.751767 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-b1c7e9c5-0ced-4bdf-8239-27bf296e411e tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:05.758193 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b1c7e9c5-0ced-4bdf-8239-27bf296e411e tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:05.758805 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b1c7e9c5-0ced-4bdf-8239-27bf296e411e tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:05.759389 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b1c7e9c5-0ced-4bdf-8239-27bf296e411e tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:05.760349 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b1c7e9c5-0ced-4bdf-8239-27bf296e411e tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:05.761039 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b1c7e9c5-0ced-4bdf-8239-27bf296e411e tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:05.761637 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b1c7e9c5-0ced-4bdf-8239-27bf296e411e tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:05.762557 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-ccaec9cd-1b58-4d81-be87-9f145aa58b8e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:05.763164 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-ccaec9cd-1b58-4d81-be87-9f145aa58b8e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:05.771779 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ccaec9cd-1b58-4d81-be87-9f145aa58b8e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:05.772296 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ccaec9cd-1b58-4d81-be87-9f145aa58b8e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:05.772732 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ccaec9cd-1b58-4d81-be87-9f145aa58b8e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:05.774191 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ccaec9cd-1b58-4d81-be87-9f145aa58b8e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:05.775910 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ccaec9cd-1b58-4d81-be87-9f145aa58b8e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:05.775910 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ccaec9cd-1b58-4d81-be87-9f145aa58b8e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:05.988993 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-ccaec9cd-1b58-4d81-be87-9f145aa58b8e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:05.992082 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-b1c7e9c5-0ced-4bdf-8239-27bf296e411e tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:05.998020 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-ccaec9cd-1b58-4d81-be87-9f145aa58b8e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:05.999409 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-ccaec9cd-1b58-4d81-be87-9f145aa58b8e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:06.000256 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-b1c7e9c5-0ced-4bdf-8239-27bf296e411e tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.253000 Sep 02 05:24:06.000645 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-ccaec9cd-1b58-4d81-be87-9f145aa58b8e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1405 microversion: 2.20 time: 0.243192 Sep 02 05:24:06.000994 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 91/191] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:05 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:06.001256 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 101/192] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:24:05 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1405 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:24:06.005881 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-cee9f128-82b3-4717-8afa-f0984f94aa84 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:06.006577 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-6850cdce-a8b5-433a-a768-f2b16263781a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:06.006901 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-cee9f128-82b3-4717-8afa-f0984f94aa84 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:06.007322 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-6850cdce-a8b5-433a-a768-f2b16263781a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:06.013070 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cee9f128-82b3-4717-8afa-f0984f94aa84 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:06.013197 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6850cdce-a8b5-433a-a768-f2b16263781a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:06.013838 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cee9f128-82b3-4717-8afa-f0984f94aa84 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:06.013945 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6850cdce-a8b5-433a-a768-f2b16263781a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:06.014410 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6850cdce-a8b5-433a-a768-f2b16263781a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:06.014880 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cee9f128-82b3-4717-8afa-f0984f94aa84 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:06.015253 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6850cdce-a8b5-433a-a768-f2b16263781a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:06.015563 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cee9f128-82b3-4717-8afa-f0984f94aa84 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:06.015733 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6850cdce-a8b5-433a-a768-f2b16263781a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:06.016011 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cee9f128-82b3-4717-8afa-f0984f94aa84 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:06.016203 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6850cdce-a8b5-433a-a768-f2b16263781a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:06.016465 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cee9f128-82b3-4717-8afa-f0984f94aa84 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:06.221882 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-cee9f128-82b3-4717-8afa-f0984f94aa84 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:06.228301 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-6850cdce-a8b5-433a-a768-f2b16263781a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:06.232341 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-cee9f128-82b3-4717-8afa-f0984f94aa84 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.229925 Sep 02 05:24:06.232944 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 92/193] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:06 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:06.237384 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-6850cdce-a8b5-433a-a768-f2b16263781a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.234886 Sep 02 05:24:06.237591 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-fdb203e5-7456-40c7-81cd-6a6398a4bb51 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:06.237917 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 102/194] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:06 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:06.238548 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-fdb203e5-7456-40c7-81cd-6a6398a4bb51 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:06.245276 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fdb203e5-7456-40c7-81cd-6a6398a4bb51 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:06.245766 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fdb203e5-7456-40c7-81cd-6a6398a4bb51 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:06.246192 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fdb203e5-7456-40c7-81cd-6a6398a4bb51 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:06.246885 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fdb203e5-7456-40c7-81cd-6a6398a4bb51 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:06.247365 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fdb203e5-7456-40c7-81cd-6a6398a4bb51 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:06.247782 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fdb203e5-7456-40c7-81cd-6a6398a4bb51 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:06.309128 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-fdb203e5-7456-40c7-81cd-6a6398a4bb51 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:06.321101 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-fdb203e5-7456-40c7-81cd-6a6398a4bb51 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1217 microversion: 2.1 time: 0.086955 Sep 02 05:24:06.321815 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 93/195] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:06 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:07.021848 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-86ea1b2a-0a90-4284-bf95-d2feaa86ec85 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:07.022389 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-86ea1b2a-0a90-4284-bf95-d2feaa86ec85 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:07.023087 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-33883f62-e05d-4a3b-8322-be3e7fb00601 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:07.023811 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-33883f62-e05d-4a3b-8322-be3e7fb00601 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:07.028867 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-86ea1b2a-0a90-4284-bf95-d2feaa86ec85 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:07.029347 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-86ea1b2a-0a90-4284-bf95-d2feaa86ec85 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:07.029778 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-86ea1b2a-0a90-4284-bf95-d2feaa86ec85 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:07.030234 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-33883f62-e05d-4a3b-8322-be3e7fb00601 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:07.030614 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-86ea1b2a-0a90-4284-bf95-d2feaa86ec85 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:07.030748 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-33883f62-e05d-4a3b-8322-be3e7fb00601 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:07.031157 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-86ea1b2a-0a90-4284-bf95-d2feaa86ec85 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:07.031292 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-33883f62-e05d-4a3b-8322-be3e7fb00601 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:07.031585 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-86ea1b2a-0a90-4284-bf95-d2feaa86ec85 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:07.031979 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-33883f62-e05d-4a3b-8322-be3e7fb00601 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:07.032517 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-33883f62-e05d-4a3b-8322-be3e7fb00601 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:07.032942 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-33883f62-e05d-4a3b-8322-be3e7fb00601 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:07.220655 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-33883f62-e05d-4a3b-8322-be3e7fb00601 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:07.229260 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-86ea1b2a-0a90-4284-bf95-d2feaa86ec85 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:07.229434 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-33883f62-e05d-4a3b-8322-be3e7fb00601 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:07.230856 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-33883f62-e05d-4a3b-8322-be3e7fb00601 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:07.231975 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-33883f62-e05d-4a3b-8322-be3e7fb00601 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1405 microversion: 2.20 time: 0.213148 Sep 02 05:24:07.232583 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 94/196] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:24:07 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1405 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:24:07.238299 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-86ea1b2a-0a90-4284-bf95-d2feaa86ec85 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.220345 Sep 02 05:24:07.239190 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 103/197] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:07 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:07.253642 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ff35e790-e3c7-4054-aa0e-aa07009abc0d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:07.254249 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-ff35e790-e3c7-4054-aa0e-aa07009abc0d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:07.258029 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-3a2c710e-65b7-486e-97b1-fe071d48e275 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:07.258715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-3a2c710e-65b7-486e-97b1-fe071d48e275 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:07.260567 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ff35e790-e3c7-4054-aa0e-aa07009abc0d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:07.260971 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ff35e790-e3c7-4054-aa0e-aa07009abc0d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:07.261501 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ff35e790-e3c7-4054-aa0e-aa07009abc0d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:07.262804 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ff35e790-e3c7-4054-aa0e-aa07009abc0d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:07.263259 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ff35e790-e3c7-4054-aa0e-aa07009abc0d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:07.263683 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ff35e790-e3c7-4054-aa0e-aa07009abc0d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:07.265819 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3a2c710e-65b7-486e-97b1-fe071d48e275 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:07.266305 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3a2c710e-65b7-486e-97b1-fe071d48e275 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:07.266740 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3a2c710e-65b7-486e-97b1-fe071d48e275 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:07.267423 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3a2c710e-65b7-486e-97b1-fe071d48e275 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:07.267885 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3a2c710e-65b7-486e-97b1-fe071d48e275 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:07.268326 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3a2c710e-65b7-486e-97b1-fe071d48e275 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:07.474452 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ff35e790-e3c7-4054-aa0e-aa07009abc0d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:07.486725 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-ff35e790-e3c7-4054-aa0e-aa07009abc0d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.236847 Sep 02 05:24:07.492664 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 95/198] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:07 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:07.496599 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5ece4df5-6a9f-43c0-aa56-d4fc174b4cb9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:07.497746 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5ece4df5-6a9f-43c0-aa56-d4fc174b4cb9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:07.503726 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-3a2c710e-65b7-486e-97b1-fe071d48e275 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:07.504654 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5ece4df5-6a9f-43c0-aa56-d4fc174b4cb9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:07.504770 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5ece4df5-6a9f-43c0-aa56-d4fc174b4cb9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:07.505183 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5ece4df5-6a9f-43c0-aa56-d4fc174b4cb9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:07.505884 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5ece4df5-6a9f-43c0-aa56-d4fc174b4cb9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:07.506335 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5ece4df5-6a9f-43c0-aa56-d4fc174b4cb9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:07.506756 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5ece4df5-6a9f-43c0-aa56-d4fc174b4cb9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:07.512826 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-3a2c710e-65b7-486e-97b1-fe071d48e275 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.258577 Sep 02 05:24:07.513402 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 104/199] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:07 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:24:07.568789 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5ece4df5-6a9f-43c0-aa56-d4fc174b4cb9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:07.576486 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5ece4df5-6a9f-43c0-aa56-d4fc174b4cb9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1217 microversion: 2.1 time: 0.086690 Sep 02 05:24:07.577041 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 96/200] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:07 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:08.255208 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-c4890125-d9a4-4c54-887c-a68c311e662d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:08.255796 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-c4890125-d9a4-4c54-887c-a68c311e662d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:08.259217 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-692a2034-c34e-4584-85b9-e01dc7cefb3a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:08.259936 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-692a2034-c34e-4584-85b9-e01dc7cefb3a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:08.262265 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c4890125-d9a4-4c54-887c-a68c311e662d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:08.262748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c4890125-d9a4-4c54-887c-a68c311e662d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:08.263175 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c4890125-d9a4-4c54-887c-a68c311e662d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:08.263867 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c4890125-d9a4-4c54-887c-a68c311e662d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:08.264344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c4890125-d9a4-4c54-887c-a68c311e662d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:08.264769 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c4890125-d9a4-4c54-887c-a68c311e662d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:08.266394 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-692a2034-c34e-4584-85b9-e01dc7cefb3a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:08.266875 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-692a2034-c34e-4584-85b9-e01dc7cefb3a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:08.267298 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-692a2034-c34e-4584-85b9-e01dc7cefb3a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:08.267980 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-692a2034-c34e-4584-85b9-e01dc7cefb3a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:08.268455 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-692a2034-c34e-4584-85b9-e01dc7cefb3a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:08.268899 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-692a2034-c34e-4584-85b9-e01dc7cefb3a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:08.284158 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=100 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:08.464050 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c4890125-d9a4-4c54-887c-a68c311e662d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:08.466882 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-692a2034-c34e-4584-85b9-e01dc7cefb3a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:08.473017 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c4890125-d9a4-4c54-887c-a68c311e662d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:08.474426 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c4890125-d9a4-4c54-887c-a68c311e662d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:08.474806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-692a2034-c34e-4584-85b9-e01dc7cefb3a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.219440 Sep 02 05:24:08.475355 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 97/201] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:08 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:08.475496 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-c4890125-d9a4-4c54-887c-a68c311e662d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1405 microversion: 2.20 time: 0.224392 Sep 02 05:24:08.476154 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 105/202] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:24:08 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1405 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:24:08.507804 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-935bd049-4563-42e1-94cc-c7ed498ec45d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:08.508503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-935bd049-4563-42e1-94cc-c7ed498ec45d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:08.514638 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-935bd049-4563-42e1-94cc-c7ed498ec45d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:08.515211 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-935bd049-4563-42e1-94cc-c7ed498ec45d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:08.515702 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-935bd049-4563-42e1-94cc-c7ed498ec45d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:08.516411 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-935bd049-4563-42e1-94cc-c7ed498ec45d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:08.516881 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-935bd049-4563-42e1-94cc-c7ed498ec45d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:08.517298 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-935bd049-4563-42e1-94cc-c7ed498ec45d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:08.533141 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-c9ebe760-f9a4-46ef-9ff9-b5a63f2ffde0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:08.533830 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-c9ebe760-f9a4-46ef-9ff9-b5a63f2ffde0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:08.540523 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c9ebe760-f9a4-46ef-9ff9-b5a63f2ffde0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:08.541094 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c9ebe760-f9a4-46ef-9ff9-b5a63f2ffde0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:08.541611 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c9ebe760-f9a4-46ef-9ff9-b5a63f2ffde0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:08.542429 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c9ebe760-f9a4-46ef-9ff9-b5a63f2ffde0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:08.543062 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c9ebe760-f9a4-46ef-9ff9-b5a63f2ffde0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:08.543553 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c9ebe760-f9a4-46ef-9ff9-b5a63f2ffde0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:08.708248 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-935bd049-4563-42e1-94cc-c7ed498ec45d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:08.722438 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-935bd049-4563-42e1-94cc-c7ed498ec45d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.218236 Sep 02 05:24:08.726754 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c9ebe760-f9a4-46ef-9ff9-b5a63f2ffde0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:08.736904 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 98/203] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:08 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:08.742334 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-26bd4769-aa65-42c4-ab51-3268b84a7240 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:08.742994 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-26bd4769-aa65-42c4-ab51-3268b84a7240 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:08.744111 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-c9ebe760-f9a4-46ef-9ff9-b5a63f2ffde0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.214565 Sep 02 05:24:08.744920 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 106/204] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:08 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:24:08.762366 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-26bd4769-aa65-42c4-ab51-3268b84a7240 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:08.762944 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-26bd4769-aa65-42c4-ab51-3268b84a7240 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:08.763437 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-26bd4769-aa65-42c4-ab51-3268b84a7240 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:08.764227 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-26bd4769-aa65-42c4-ab51-3268b84a7240 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:08.764716 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-26bd4769-aa65-42c4-ab51-3268b84a7240 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:08.765158 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-26bd4769-aa65-42c4-ab51-3268b84a7240 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:08.833010 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-26bd4769-aa65-42c4-ab51-3268b84a7240 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:08.841319 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-26bd4769-aa65-42c4-ab51-3268b84a7240 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1217 microversion: 2.1 time: 0.103270 Sep 02 05:24:08.842105 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 99/205] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:08 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:09.496938 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-b9679ee2-2bd4-4111-a082-d5fd72491ae8 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:09.497704 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-b9679ee2-2bd4-4111-a082-d5fd72491ae8 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:09.499036 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-fbd1a60c-5b44-4294-a912-ca0ef2170ca5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:09.499423 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-fbd1a60c-5b44-4294-a912-ca0ef2170ca5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:09.501899 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell0:SELECT=2 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:09.502262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell0:SELECT=2 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:09.502896 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell0:SELECT=6 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:09.506542 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fbd1a60c-5b44-4294-a912-ca0ef2170ca5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:09.506888 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b9679ee2-2bd4-4111-a082-d5fd72491ae8 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:09.507042 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fbd1a60c-5b44-4294-a912-ca0ef2170ca5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:09.507415 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fbd1a60c-5b44-4294-a912-ca0ef2170ca5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:09.507837 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b9679ee2-2bd4-4111-a082-d5fd72491ae8 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:09.508095 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fbd1a60c-5b44-4294-a912-ca0ef2170ca5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:09.508619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b9679ee2-2bd4-4111-a082-d5fd72491ae8 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:09.508902 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fbd1a60c-5b44-4294-a912-ca0ef2170ca5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:09.509306 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fbd1a60c-5b44-4294-a912-ca0ef2170ca5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:09.509410 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b9679ee2-2bd4-4111-a082-d5fd72491ae8 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:09.510123 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b9679ee2-2bd4-4111-a082-d5fd72491ae8 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:09.510230 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b9679ee2-2bd4-4111-a082-d5fd72491ae8 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:09.789601 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-fbd1a60c-5b44-4294-a912-ca0ef2170ca5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:09.799959 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-fbd1a60c-5b44-4294-a912-ca0ef2170ca5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:09.801429 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-fbd1a60c-5b44-4294-a912-ca0ef2170ca5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:09.802799 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-fbd1a60c-5b44-4294-a912-ca0ef2170ca5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1405 microversion: 2.20 time: 0.308424 Sep 02 05:24:09.803596 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 100/206] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:24:09 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1405 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:24:09.808721 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-4ca398d9-54c8-4ed2-8977-17e95f474370 req-2729254b-d154-4820-9afb-5447bb841623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e32b402-d6f2-4861-a864-005e1a9f808d", "name": "network-vif-plugged", "status": "completed", "tag": "26f374c2-ecf9-4064-b5ad-13f47d97521e"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:24:09.819661 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-4ca398d9-54c8-4ed2-8977-17e95f474370 req-2729254b-d154-4820-9afb-5447bb841623 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:09.820629 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-4ca398d9-54c8-4ed2-8977-17e95f474370 req-2729254b-d154-4820-9afb-5447bb841623 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:09.821401 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-4ca398d9-54c8-4ed2-8977-17e95f474370 req-2729254b-d154-4820-9afb-5447bb841623 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:09.828548 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-b9679ee2-2bd4-4111-a082-d5fd72491ae8 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:09.837157 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-b9679ee2-2bd4-4111-a082-d5fd72491ae8 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.345179 Sep 02 05:24:09.837933 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 107/207] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:09 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:09.843623 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-4ca398d9-54c8-4ed2-8977-17e95f474370 req-2729254b-d154-4820-9afb-5447bb841623 service nova] Creating event network-vif-plugged:26f374c2-ecf9-4064-b5ad-13f47d97521e for instance 1e32b402-d6f2-4861-a864-005e1a9f808d on hv-cinder-85391 Sep 02 05:24:09.844036 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-c54b13dc-e72a-45a9-8148-e00c69cd34c7 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:09.845018 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-c54b13dc-e72a-45a9-8148-e00c69cd34c7 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:09.850566 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-4ca398d9-54c8-4ed2-8977-17e95f474370 req-2729254b-d154-4820-9afb-5447bb841623 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045061 Sep 02 05:24:09.852087 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 101/208] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:24:09.854765 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c54b13dc-e72a-45a9-8148-e00c69cd34c7 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:09.855439 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c54b13dc-e72a-45a9-8148-e00c69cd34c7 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:09.856730 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c54b13dc-e72a-45a9-8148-e00c69cd34c7 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:09.857702 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c54b13dc-e72a-45a9-8148-e00c69cd34c7 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:09.859102 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c54b13dc-e72a-45a9-8148-e00c69cd34c7 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:09.859848 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c54b13dc-e72a-45a9-8148-e00c69cd34c7 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:09.861610 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-fb8c121a-98fd-4bb3-83a1-d8bf2ff1aaa2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:09.862462 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-fb8c121a-98fd-4bb3-83a1-d8bf2ff1aaa2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:09.871493 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fb8c121a-98fd-4bb3-83a1-d8bf2ff1aaa2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:09.872317 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fb8c121a-98fd-4bb3-83a1-d8bf2ff1aaa2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:09.872941 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fb8c121a-98fd-4bb3-83a1-d8bf2ff1aaa2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:09.874085 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fb8c121a-98fd-4bb3-83a1-d8bf2ff1aaa2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:09.874925 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fb8c121a-98fd-4bb3-83a1-d8bf2ff1aaa2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:09.875923 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fb8c121a-98fd-4bb3-83a1-d8bf2ff1aaa2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:10.088055 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c54b13dc-e72a-45a9-8148-e00c69cd34c7 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:10.104176 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-fb8c121a-98fd-4bb3-83a1-d8bf2ff1aaa2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:10.105553 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-c54b13dc-e72a-45a9-8148-e00c69cd34c7 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.257828 Sep 02 05:24:10.119440 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=100 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:10.119635 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 108/209] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:09 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:10.119717 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-fb8c121a-98fd-4bb3-83a1-d8bf2ff1aaa2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.262961 Sep 02 05:24:10.119717 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 102/210] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:09 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:10.139766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-4ecd9f3f-f03a-4ef5-8253-393d2a5ba643 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:10.140487 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-4ecd9f3f-f03a-4ef5-8253-393d2a5ba643 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:10.146581 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4ecd9f3f-f03a-4ef5-8253-393d2a5ba643 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:10.147106 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4ecd9f3f-f03a-4ef5-8253-393d2a5ba643 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:10.147542 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4ecd9f3f-f03a-4ef5-8253-393d2a5ba643 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:10.148405 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4ecd9f3f-f03a-4ef5-8253-393d2a5ba643 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:10.149089 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4ecd9f3f-f03a-4ef5-8253-393d2a5ba643 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:10.149769 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4ecd9f3f-f03a-4ef5-8253-393d2a5ba643 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:10.236473 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-4ecd9f3f-f03a-4ef5-8253-393d2a5ba643 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:10.255770 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-4ecd9f3f-f03a-4ef5-8253-393d2a5ba643 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1217 microversion: 2.1 time: 0.139849 Sep 02 05:24:10.256415 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 109/211] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:10 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1217 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:10.828053 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5a7aed1b-c030-44dd-b98f-85f351241242 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:10.828806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5a7aed1b-c030-44dd-b98f-85f351241242 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:10.835279 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5a7aed1b-c030-44dd-b98f-85f351241242 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:10.835861 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5a7aed1b-c030-44dd-b98f-85f351241242 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:10.836354 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5a7aed1b-c030-44dd-b98f-85f351241242 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:10.837094 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5a7aed1b-c030-44dd-b98f-85f351241242 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:10.837584 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5a7aed1b-c030-44dd-b98f-85f351241242 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:10.838005 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5a7aed1b-c030-44dd-b98f-85f351241242 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:10.858287 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-ab83cb03-48f7-4e8e-8679-5f314b11c7ca tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:10.859564 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-ab83cb03-48f7-4e8e-8679-5f314b11c7ca tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:10.866280 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ab83cb03-48f7-4e8e-8679-5f314b11c7ca tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:10.866813 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ab83cb03-48f7-4e8e-8679-5f314b11c7ca tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:10.867491 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ab83cb03-48f7-4e8e-8679-5f314b11c7ca tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:10.868810 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ab83cb03-48f7-4e8e-8679-5f314b11c7ca tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:10.869328 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ab83cb03-48f7-4e8e-8679-5f314b11c7ca tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:10.871501 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ab83cb03-48f7-4e8e-8679-5f314b11c7ca tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:11.033356 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5a7aed1b-c030-44dd-b98f-85f351241242 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:11.042160 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5a7aed1b-c030-44dd-b98f-85f351241242 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:11.043584 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5a7aed1b-c030-44dd-b98f-85f351241242 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:11.044742 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5a7aed1b-c030-44dd-b98f-85f351241242 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1405 microversion: 2.20 time: 0.221382 Sep 02 05:24:11.045302 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 103/212] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:24:10 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1405 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:24:11.063466 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-ab83cb03-48f7-4e8e-8679-5f314b11c7ca tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:11.071236 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-ab83cb03-48f7-4e8e-8679-5f314b11c7ca tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.217034 Sep 02 05:24:11.071791 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 110/213] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:10 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:11.136789 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-25e254f8-e119-4dd7-93b3-39cb77c2399a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:11.137525 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-25e254f8-e119-4dd7-93b3-39cb77c2399a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:11.142218 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-af8fff0f-ac8f-4691-b636-54a62a24ca09 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:11.142989 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-af8fff0f-ac8f-4691-b636-54a62a24ca09 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:11.144497 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-25e254f8-e119-4dd7-93b3-39cb77c2399a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:11.145214 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-25e254f8-e119-4dd7-93b3-39cb77c2399a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:11.145758 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-25e254f8-e119-4dd7-93b3-39cb77c2399a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:11.146696 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-25e254f8-e119-4dd7-93b3-39cb77c2399a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:11.147333 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-25e254f8-e119-4dd7-93b3-39cb77c2399a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:11.147840 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-25e254f8-e119-4dd7-93b3-39cb77c2399a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:11.148938 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-af8fff0f-ac8f-4691-b636-54a62a24ca09 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:11.149415 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-af8fff0f-ac8f-4691-b636-54a62a24ca09 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:11.149840 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-af8fff0f-ac8f-4691-b636-54a62a24ca09 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:11.150539 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-af8fff0f-ac8f-4691-b636-54a62a24ca09 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:11.151154 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-af8fff0f-ac8f-4691-b636-54a62a24ca09 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:11.151685 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-af8fff0f-ac8f-4691-b636-54a62a24ca09 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:11.364359 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-af8fff0f-ac8f-4691-b636-54a62a24ca09 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:11.366355 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-25e254f8-e119-4dd7-93b3-39cb77c2399a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:11.380041 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-af8fff0f-ac8f-4691-b636-54a62a24ca09 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.242908 Sep 02 05:24:11.380631 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-25e254f8-e119-4dd7-93b3-39cb77c2399a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.248085 Sep 02 05:24:11.380989 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 111/214] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:11 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:24:11.385874 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-dfcb72bf-49a8-4638-b21d-e28bbdb24dab tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:11.386545 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-dfcb72bf-49a8-4638-b21d-e28bbdb24dab tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:11.394952 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 104/215] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:11 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:11.395200 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dfcb72bf-49a8-4638-b21d-e28bbdb24dab tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:11.395200 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dfcb72bf-49a8-4638-b21d-e28bbdb24dab tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:11.395200 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dfcb72bf-49a8-4638-b21d-e28bbdb24dab tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:11.395200 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dfcb72bf-49a8-4638-b21d-e28bbdb24dab tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:11.395517 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dfcb72bf-49a8-4638-b21d-e28bbdb24dab tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:11.395599 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dfcb72bf-49a8-4638-b21d-e28bbdb24dab tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:11.457036 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-dfcb72bf-49a8-4638-b21d-e28bbdb24dab tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:11.464972 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-dfcb72bf-49a8-4638-b21d-e28bbdb24dab tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1209 microversion: 2.1 time: 0.082754 Sep 02 05:24:11.465767 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 112/216] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:11 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1209 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:11.867034 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-9672102f-aef8-48cb-b0c0-0133dd1e42a7 req-31e8b6ed-6452-4d9f-b6dc-34720438376a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ecefc31-2d93-4601-91e7-0d18da502d8b", "name": "network-vif-plugged", "status": "completed", "tag": "5c422bbe-4e68-47eb-b4b1-26e72bf162b6"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:24:11.877903 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-9672102f-aef8-48cb-b0c0-0133dd1e42a7 req-31e8b6ed-6452-4d9f-b6dc-34720438376a service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:11.878444 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-9672102f-aef8-48cb-b0c0-0133dd1e42a7 req-31e8b6ed-6452-4d9f-b6dc-34720438376a service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:11.878932 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-9672102f-aef8-48cb-b0c0-0133dd1e42a7 req-31e8b6ed-6452-4d9f-b6dc-34720438376a service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:11.889746 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-9672102f-aef8-48cb-b0c0-0133dd1e42a7 req-31e8b6ed-6452-4d9f-b6dc-34720438376a service nova] Creating event network-vif-plugged:5c422bbe-4e68-47eb-b4b1-26e72bf162b6 for instance 6ecefc31-2d93-4601-91e7-0d18da502d8b on hv-cinder-85391 Sep 02 05:24:11.895284 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-9672102f-aef8-48cb-b0c0-0133dd1e42a7 req-31e8b6ed-6452-4d9f-b6dc-34720438376a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032224 Sep 02 05:24:11.895825 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 105/217] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:24:12.068726 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-586198c0-96c9-4b3b-9039-7c2d04d02357 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:12.069333 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-586198c0-96c9-4b3b-9039-7c2d04d02357 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:12.075347 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-586198c0-96c9-4b3b-9039-7c2d04d02357 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:12.075847 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-586198c0-96c9-4b3b-9039-7c2d04d02357 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:12.076336 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-586198c0-96c9-4b3b-9039-7c2d04d02357 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:12.077061 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-586198c0-96c9-4b3b-9039-7c2d04d02357 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:12.077516 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-586198c0-96c9-4b3b-9039-7c2d04d02357 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:12.077980 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-586198c0-96c9-4b3b-9039-7c2d04d02357 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:12.094884 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ef6d4bf5-48ff-446f-adae-a682033f5402 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:12.095888 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-ef6d4bf5-48ff-446f-adae-a682033f5402 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:12.102623 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ef6d4bf5-48ff-446f-adae-a682033f5402 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:12.103108 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ef6d4bf5-48ff-446f-adae-a682033f5402 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:12.103539 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ef6d4bf5-48ff-446f-adae-a682033f5402 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:12.104254 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ef6d4bf5-48ff-446f-adae-a682033f5402 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:12.104745 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ef6d4bf5-48ff-446f-adae-a682033f5402 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:12.105166 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ef6d4bf5-48ff-446f-adae-a682033f5402 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:12.277895 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-586198c0-96c9-4b3b-9039-7c2d04d02357 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:12.287320 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-586198c0-96c9-4b3b-9039-7c2d04d02357 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:12.288783 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-586198c0-96c9-4b3b-9039-7c2d04d02357 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:12.290063 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-586198c0-96c9-4b3b-9039-7c2d04d02357 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1405 microversion: 2.20 time: 0.225282 Sep 02 05:24:12.290615 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 113/218] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:24:12 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1405 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:24:12.302595 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ef6d4bf5-48ff-446f-adae-a682033f5402 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:12.302595 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-ef6d4bf5-48ff-446f-adae-a682033f5402 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.211898 Sep 02 05:24:12.302595 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 106/219] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:12 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:24:12.404411 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-2aafb9ff-e36d-4dbb-9ca6-afcc7a3d4878 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:12.405037 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-2aafb9ff-e36d-4dbb-9ca6-afcc7a3d4878 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:12.409039 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-cde723ea-ab06-4dae-b746-87f0e6356065 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:12.409638 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-cde723ea-ab06-4dae-b746-87f0e6356065 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:12.411560 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2aafb9ff-e36d-4dbb-9ca6-afcc7a3d4878 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:12.412055 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2aafb9ff-e36d-4dbb-9ca6-afcc7a3d4878 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:12.412531 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2aafb9ff-e36d-4dbb-9ca6-afcc7a3d4878 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:12.413216 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2aafb9ff-e36d-4dbb-9ca6-afcc7a3d4878 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:12.413918 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2aafb9ff-e36d-4dbb-9ca6-afcc7a3d4878 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:12.414550 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2aafb9ff-e36d-4dbb-9ca6-afcc7a3d4878 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:12.416255 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cde723ea-ab06-4dae-b746-87f0e6356065 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:12.416932 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cde723ea-ab06-4dae-b746-87f0e6356065 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:12.417430 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cde723ea-ab06-4dae-b746-87f0e6356065 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:12.418109 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cde723ea-ab06-4dae-b746-87f0e6356065 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:12.418551 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cde723ea-ab06-4dae-b746-87f0e6356065 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:12.419216 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cde723ea-ab06-4dae-b746-87f0e6356065 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:12.604847 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-2aafb9ff-e36d-4dbb-9ca6-afcc7a3d4878 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:12.616097 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-2aafb9ff-e36d-4dbb-9ca6-afcc7a3d4878 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.217528 Sep 02 05:24:12.616869 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 107/220] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:12 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:12.623903 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5faeacd2-9634-4ceb-92bd-423654f27714 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:12.624551 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5faeacd2-9634-4ceb-92bd-423654f27714 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:12.627927 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-cde723ea-ab06-4dae-b746-87f0e6356065 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:12.632466 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5faeacd2-9634-4ceb-92bd-423654f27714 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:12.632998 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5faeacd2-9634-4ceb-92bd-423654f27714 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:12.633426 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5faeacd2-9634-4ceb-92bd-423654f27714 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:12.634267 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5faeacd2-9634-4ceb-92bd-423654f27714 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:12.634826 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5faeacd2-9634-4ceb-92bd-423654f27714 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:12.635761 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5faeacd2-9634-4ceb-92bd-423654f27714 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:12.637685 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-cde723ea-ab06-4dae-b746-87f0e6356065 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.232499 Sep 02 05:24:12.652687 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 114/221] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:12 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:12.744928 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5faeacd2-9634-4ceb-92bd-423654f27714 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:12.764748 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5faeacd2-9634-4ceb-92bd-423654f27714 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1209 microversion: 2.1 time: 0.146505 Sep 02 05:24:12.765306 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 108/222] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:12 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1209 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:13.314688 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-3d073d41-a191-4e06-b823-f975311748ac tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:13.316508 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-3d073d41-a191-4e06-b823-f975311748ac tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:13.322405 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-a18d2062-e86c-40bd-8157-ca0e8938b6e3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:13.323607 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-a18d2062-e86c-40bd-8157-ca0e8938b6e3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:13.337883 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3d073d41-a191-4e06-b823-f975311748ac tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:13.338916 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a18d2062-e86c-40bd-8157-ca0e8938b6e3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:13.340363 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a18d2062-e86c-40bd-8157-ca0e8938b6e3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:13.341424 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3d073d41-a191-4e06-b823-f975311748ac tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:13.342417 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a18d2062-e86c-40bd-8157-ca0e8938b6e3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:13.344639 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3d073d41-a191-4e06-b823-f975311748ac tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:13.345670 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a18d2062-e86c-40bd-8157-ca0e8938b6e3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:13.347074 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a18d2062-e86c-40bd-8157-ca0e8938b6e3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:13.350551 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3d073d41-a191-4e06-b823-f975311748ac tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:13.356198 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a18d2062-e86c-40bd-8157-ca0e8938b6e3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:13.357161 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3d073d41-a191-4e06-b823-f975311748ac tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:13.360724 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3d073d41-a191-4e06-b823-f975311748ac tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:13.686708 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-a18d2062-e86c-40bd-8157-ca0e8938b6e3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:13.698427 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-a18d2062-e86c-40bd-8157-ca0e8938b6e3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.379868 Sep 02 05:24:13.700364 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 109/223] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:13 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:13.705563 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-464ad00f-ac97-4ee6-91df-7fc60e0be93a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:13.706244 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-464ad00f-ac97-4ee6-91df-7fc60e0be93a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:13.712036 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-3d073d41-a191-4e06-b823-f975311748ac tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:13.713338 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-464ad00f-ac97-4ee6-91df-7fc60e0be93a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:13.714064 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-464ad00f-ac97-4ee6-91df-7fc60e0be93a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:13.714940 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-464ad00f-ac97-4ee6-91df-7fc60e0be93a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:13.716374 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-464ad00f-ac97-4ee6-91df-7fc60e0be93a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:13.717213 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-464ad00f-ac97-4ee6-91df-7fc60e0be93a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:13.717856 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-464ad00f-ac97-4ee6-91df-7fc60e0be93a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:13.726368 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-3d073d41-a191-4e06-b823-f975311748ac tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:13.728515 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-3d073d41-a191-4e06-b823-f975311748ac tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:13.730105 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-3d073d41-a191-4e06-b823-f975311748ac tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1405 microversion: 2.20 time: 0.419379 Sep 02 05:24:13.746147 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 115/224] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:24:13 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1405 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:24:13.750408 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-a278e0fb-c9e9-4deb-bdb8-42ebbab02e9c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:13.751278 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-a278e0fb-c9e9-4deb-bdb8-42ebbab02e9c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:13.757993 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a278e0fb-c9e9-4deb-bdb8-42ebbab02e9c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:13.758516 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a278e0fb-c9e9-4deb-bdb8-42ebbab02e9c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:13.759208 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a278e0fb-c9e9-4deb-bdb8-42ebbab02e9c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:13.760271 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a278e0fb-c9e9-4deb-bdb8-42ebbab02e9c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:13.760904 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a278e0fb-c9e9-4deb-bdb8-42ebbab02e9c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:13.761457 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a278e0fb-c9e9-4deb-bdb8-42ebbab02e9c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:13.973904 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-a278e0fb-c9e9-4deb-bdb8-42ebbab02e9c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:13.982045 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-464ad00f-ac97-4ee6-91df-7fc60e0be93a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:13.984455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-a278e0fb-c9e9-4deb-bdb8-42ebbab02e9c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.245635 Sep 02 05:24:13.985018 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 116/225] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:13 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:13.990650 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-eb1b2e0b-b1d1-4e67-9bfc-5ed53d1980c4 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:13.996357 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-eb1b2e0b-b1d1-4e67-9bfc-5ed53d1980c4 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:13.997490 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-464ad00f-ac97-4ee6-91df-7fc60e0be93a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.295321 Sep 02 05:24:14.000759 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 110/226] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:13 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:14.004464 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eb1b2e0b-b1d1-4e67-9bfc-5ed53d1980c4 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:14.004953 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eb1b2e0b-b1d1-4e67-9bfc-5ed53d1980c4 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:14.005380 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eb1b2e0b-b1d1-4e67-9bfc-5ed53d1980c4 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:14.006066 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eb1b2e0b-b1d1-4e67-9bfc-5ed53d1980c4 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:14.006514 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eb1b2e0b-b1d1-4e67-9bfc-5ed53d1980c4 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:14.006929 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eb1b2e0b-b1d1-4e67-9bfc-5ed53d1980c4 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:14.099679 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-eb1b2e0b-b1d1-4e67-9bfc-5ed53d1980c4 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:14.111359 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-eb1b2e0b-b1d1-4e67-9bfc-5ed53d1980c4 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1209 microversion: 2.1 time: 0.124687 Sep 02 05:24:14.132675 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 117/227] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:13 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1209 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:14.720805 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-62cedc6d-d339-4ced-9ad8-b4be8fe46275 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:14.722103 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-62cedc6d-d339-4ced-9ad8-b4be8fe46275 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:14.728348 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-62cedc6d-d339-4ced-9ad8-b4be8fe46275 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:14.729065 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-62cedc6d-d339-4ced-9ad8-b4be8fe46275 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:14.729777 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-62cedc6d-d339-4ced-9ad8-b4be8fe46275 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:14.730672 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-62cedc6d-d339-4ced-9ad8-b4be8fe46275 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:14.731439 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-62cedc6d-d339-4ced-9ad8-b4be8fe46275 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:14.732051 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-62cedc6d-d339-4ced-9ad8-b4be8fe46275 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:14.754788 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-68339502-1824-44da-9cda-a7810cf07d26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:14.756742 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-68339502-1824-44da-9cda-a7810cf07d26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:14.764539 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-68339502-1824-44da-9cda-a7810cf07d26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:14.765162 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-68339502-1824-44da-9cda-a7810cf07d26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:14.765732 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-68339502-1824-44da-9cda-a7810cf07d26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:14.766776 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-68339502-1824-44da-9cda-a7810cf07d26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:14.769876 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-68339502-1824-44da-9cda-a7810cf07d26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:14.770345 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-68339502-1824-44da-9cda-a7810cf07d26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:14.949497 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-62cedc6d-d339-4ced-9ad8-b4be8fe46275 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:14.958863 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-62cedc6d-d339-4ced-9ad8-b4be8fe46275 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.241946 Sep 02 05:24:14.959441 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 111/228] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:14 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:14.965221 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-68339502-1824-44da-9cda-a7810cf07d26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:14.981275 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-68339502-1824-44da-9cda-a7810cf07d26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:14.983045 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-68339502-1824-44da-9cda-a7810cf07d26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:14.984393 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-68339502-1824-44da-9cda-a7810cf07d26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1405 microversion: 2.20 time: 0.234381 Sep 02 05:24:14.985019 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 118/229] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:24:14 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1405 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:24:15.008469 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-3f409a39-a15f-41b7-a27a-ff3209021d2c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:15.009074 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-3f409a39-a15f-41b7-a27a-ff3209021d2c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:15.020433 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3f409a39-a15f-41b7-a27a-ff3209021d2c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:15.020856 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f5a143a4-0bba-43ef-ad0e-02992d60ee13 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:15.021549 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f5a143a4-0bba-43ef-ad0e-02992d60ee13 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:15.021869 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3f409a39-a15f-41b7-a27a-ff3209021d2c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:15.022846 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3f409a39-a15f-41b7-a27a-ff3209021d2c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:15.024343 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3f409a39-a15f-41b7-a27a-ff3209021d2c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:15.025032 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3f409a39-a15f-41b7-a27a-ff3209021d2c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:15.025583 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3f409a39-a15f-41b7-a27a-ff3209021d2c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:15.027975 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f5a143a4-0bba-43ef-ad0e-02992d60ee13 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:15.028633 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f5a143a4-0bba-43ef-ad0e-02992d60ee13 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:15.029229 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f5a143a4-0bba-43ef-ad0e-02992d60ee13 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:15.030073 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f5a143a4-0bba-43ef-ad0e-02992d60ee13 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:15.030679 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f5a143a4-0bba-43ef-ad0e-02992d60ee13 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:15.031433 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f5a143a4-0bba-43ef-ad0e-02992d60ee13 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:15.282079 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-3f409a39-a15f-41b7-a27a-ff3209021d2c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:15.290340 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-3f409a39-a15f-41b7-a27a-ff3209021d2c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.285786 Sep 02 05:24:15.303743 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f5a143a4-0bba-43ef-ad0e-02992d60ee13 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:15.304317 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 112/230] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:15 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:15.305582 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f5a143a4-0bba-43ef-ad0e-02992d60ee13 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.289372 Sep 02 05:24:15.306251 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 119/231] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:15 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:24:15.310119 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-07139978-3339-40e1-99f1-92de12ab4370 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:15.310805 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-07139978-3339-40e1-99f1-92de12ab4370 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:15.325484 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-07139978-3339-40e1-99f1-92de12ab4370 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:15.326363 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-07139978-3339-40e1-99f1-92de12ab4370 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:15.326865 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-07139978-3339-40e1-99f1-92de12ab4370 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:15.327946 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-07139978-3339-40e1-99f1-92de12ab4370 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:15.328055 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-07139978-3339-40e1-99f1-92de12ab4370 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:15.328465 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-07139978-3339-40e1-99f1-92de12ab4370 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:15.406979 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-07139978-3339-40e1-99f1-92de12ab4370 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:15.416087 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-07139978-3339-40e1-99f1-92de12ab4370 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1209 microversion: 2.1 time: 0.110456 Sep 02 05:24:15.416966 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 113/232] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:15 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1209 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:15.980577 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f1799b67-f7d5-4e74-8907-2389931632c3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:15.981985 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f1799b67-f7d5-4e74-8907-2389931632c3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:15.989058 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f1799b67-f7d5-4e74-8907-2389931632c3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:15.989870 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f1799b67-f7d5-4e74-8907-2389931632c3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:15.990529 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f1799b67-f7d5-4e74-8907-2389931632c3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:15.991524 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f1799b67-f7d5-4e74-8907-2389931632c3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:15.992189 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f1799b67-f7d5-4e74-8907-2389931632c3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:15.992886 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f1799b67-f7d5-4e74-8907-2389931632c3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:16.009644 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-009c4f31-1e0a-4a1e-8642-34a7fdd85bbd tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:16.011147 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-009c4f31-1e0a-4a1e-8642-34a7fdd85bbd tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:16.017663 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-009c4f31-1e0a-4a1e-8642-34a7fdd85bbd tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:16.018140 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-009c4f31-1e0a-4a1e-8642-34a7fdd85bbd tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:16.018561 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-009c4f31-1e0a-4a1e-8642-34a7fdd85bbd tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:16.019227 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-009c4f31-1e0a-4a1e-8642-34a7fdd85bbd tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:16.019921 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-009c4f31-1e0a-4a1e-8642-34a7fdd85bbd tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:16.020363 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-009c4f31-1e0a-4a1e-8642-34a7fdd85bbd tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:16.231968 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f1799b67-f7d5-4e74-8907-2389931632c3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:16.236661 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-009c4f31-1e0a-4a1e-8642-34a7fdd85bbd tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:16.239823 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f1799b67-f7d5-4e74-8907-2389931632c3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.263957 Sep 02 05:24:16.252355 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-009c4f31-1e0a-4a1e-8642-34a7fdd85bbd tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:16.252972 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 120/233] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:15 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:16.259285 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-009c4f31-1e0a-4a1e-8642-34a7fdd85bbd tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:16.260594 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-009c4f31-1e0a-4a1e-8642-34a7fdd85bbd tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1405 microversion: 2.20 time: 0.256009 Sep 02 05:24:16.261430 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 114/234] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:24:16 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1405 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:24:16.310889 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-4ad5f358-81a1-4041-826d-8a25a47ddef8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:16.311570 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-4ad5f358-81a1-4041-826d-8a25a47ddef8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:16.317572 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4ad5f358-81a1-4041-826d-8a25a47ddef8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:16.318340 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4ad5f358-81a1-4041-826d-8a25a47ddef8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:16.318867 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4ad5f358-81a1-4041-826d-8a25a47ddef8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:16.319618 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4ad5f358-81a1-4041-826d-8a25a47ddef8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:16.320382 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4ad5f358-81a1-4041-826d-8a25a47ddef8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:16.320780 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4ad5f358-81a1-4041-826d-8a25a47ddef8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:16.328868 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ac64762e-d12e-4012-a49a-b8ce1af0265e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:16.329466 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-ac64762e-d12e-4012-a49a-b8ce1af0265e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:16.335978 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ac64762e-d12e-4012-a49a-b8ce1af0265e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:16.336615 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ac64762e-d12e-4012-a49a-b8ce1af0265e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:16.337040 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ac64762e-d12e-4012-a49a-b8ce1af0265e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:16.337841 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ac64762e-d12e-4012-a49a-b8ce1af0265e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:16.338282 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ac64762e-d12e-4012-a49a-b8ce1af0265e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:16.339016 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ac64762e-d12e-4012-a49a-b8ce1af0265e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:16.550577 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ac64762e-d12e-4012-a49a-b8ce1af0265e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:16.555882 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-4ad5f358-81a1-4041-826d-8a25a47ddef8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:16.559179 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-ac64762e-d12e-4012-a49a-b8ce1af0265e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.234609 Sep 02 05:24:16.560882 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 115/235] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:16 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:16.566644 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-4ad5f358-81a1-4041-826d-8a25a47ddef8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.259369 Sep 02 05:24:16.569420 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-b54c0d87-5fae-4aa4-977f-afe1f6bc776c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:16.570198 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-b54c0d87-5fae-4aa4-977f-afe1f6bc776c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:16.576738 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 121/236] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:16 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:16.577036 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b54c0d87-5fae-4aa4-977f-afe1f6bc776c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:16.577853 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b54c0d87-5fae-4aa4-977f-afe1f6bc776c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:16.578335 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b54c0d87-5fae-4aa4-977f-afe1f6bc776c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:16.579102 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b54c0d87-5fae-4aa4-977f-afe1f6bc776c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:16.579913 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b54c0d87-5fae-4aa4-977f-afe1f6bc776c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:16.580047 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b54c0d87-5fae-4aa4-977f-afe1f6bc776c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:16.677343 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-b54c0d87-5fae-4aa4-977f-afe1f6bc776c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:16.686282 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-b54c0d87-5fae-4aa4-977f-afe1f6bc776c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1209 microversion: 2.1 time: 0.120980 Sep 02 05:24:16.687416 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 116/237] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:16 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1209 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:17.261895 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d51e2398-ec93-4033-97b3-e47cb2e7f02c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:17.262491 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-d51e2398-ec93-4033-97b3-e47cb2e7f02c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:17.268563 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d51e2398-ec93-4033-97b3-e47cb2e7f02c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:17.269087 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d51e2398-ec93-4033-97b3-e47cb2e7f02c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:17.269514 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d51e2398-ec93-4033-97b3-e47cb2e7f02c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:17.270195 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d51e2398-ec93-4033-97b3-e47cb2e7f02c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:17.270643 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d51e2398-ec93-4033-97b3-e47cb2e7f02c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:17.271059 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d51e2398-ec93-4033-97b3-e47cb2e7f02c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:17.275039 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=100 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:17.285249 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-203a9896-e12b-40da-a586-3298de382078 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:17.286526 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-203a9896-e12b-40da-a586-3298de382078 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:17.294518 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-203a9896-e12b-40da-a586-3298de382078 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:17.295310 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-203a9896-e12b-40da-a586-3298de382078 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:17.296056 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-203a9896-e12b-40da-a586-3298de382078 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:17.297370 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-203a9896-e12b-40da-a586-3298de382078 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:17.298045 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-203a9896-e12b-40da-a586-3298de382078 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:17.298702 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-203a9896-e12b-40da-a586-3298de382078 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:17.479899 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d51e2398-ec93-4033-97b3-e47cb2e7f02c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:17.483363 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-203a9896-e12b-40da-a586-3298de382078 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:17.488676 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-d51e2398-ec93-4033-97b3-e47cb2e7f02c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.230472 Sep 02 05:24:17.489338 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 122/238] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:17 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:17.505614 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-203a9896-e12b-40da-a586-3298de382078 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:17.507013 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-203a9896-e12b-40da-a586-3298de382078 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:17.508105 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-203a9896-e12b-40da-a586-3298de382078 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1405 microversion: 2.20 time: 0.227251 Sep 02 05:24:17.508833 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 117/239] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:24:17 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1405 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:24:17.580999 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-3d71fabb-8e0f-489b-8961-4f7df9d404f6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:17.581597 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-3d71fabb-8e0f-489b-8961-4f7df9d404f6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:17.587906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3d71fabb-8e0f-489b-8961-4f7df9d404f6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:17.588496 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3d71fabb-8e0f-489b-8961-4f7df9d404f6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:17.589082 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-c3eb919d-bd2c-4c49-a503-ed303236c149 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:17.589218 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3d71fabb-8e0f-489b-8961-4f7df9d404f6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:17.589680 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-c3eb919d-bd2c-4c49-a503-ed303236c149 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:17.589810 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3d71fabb-8e0f-489b-8961-4f7df9d404f6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:17.590319 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3d71fabb-8e0f-489b-8961-4f7df9d404f6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:17.590792 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3d71fabb-8e0f-489b-8961-4f7df9d404f6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:17.595905 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c3eb919d-bd2c-4c49-a503-ed303236c149 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:17.596383 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c3eb919d-bd2c-4c49-a503-ed303236c149 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:17.596963 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c3eb919d-bd2c-4c49-a503-ed303236c149 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:17.597833 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c3eb919d-bd2c-4c49-a503-ed303236c149 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:17.598278 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c3eb919d-bd2c-4c49-a503-ed303236c149 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:17.598691 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c3eb919d-bd2c-4c49-a503-ed303236c149 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:17.794363 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-3d71fabb-8e0f-489b-8961-4f7df9d404f6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:17.798635 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-c3eb919d-bd2c-4c49-a503-ed303236c149 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:17.808713 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-3d71fabb-8e0f-489b-8961-4f7df9d404f6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.231439 Sep 02 05:24:17.809285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 123/240] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:17 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:17.816313 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-c3eb919d-bd2c-4c49-a503-ed303236c149 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.225298 Sep 02 05:24:17.816313 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 118/241] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:17 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:17.816313 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-4ac4751a-eb78-4a5c-baad-81abc3dca955 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:17.816313 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-4ac4751a-eb78-4a5c-baad-81abc3dca955 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:17.821497 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4ac4751a-eb78-4a5c-baad-81abc3dca955 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:17.821966 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4ac4751a-eb78-4a5c-baad-81abc3dca955 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:17.822393 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4ac4751a-eb78-4a5c-baad-81abc3dca955 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:17.823088 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4ac4751a-eb78-4a5c-baad-81abc3dca955 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:17.823533 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4ac4751a-eb78-4a5c-baad-81abc3dca955 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:17.823946 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4ac4751a-eb78-4a5c-baad-81abc3dca955 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:17.886020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-4ac4751a-eb78-4a5c-baad-81abc3dca955 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:17.898097 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-4ac4751a-eb78-4a5c-baad-81abc3dca955 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1209 microversion: 2.1 time: 0.086033 Sep 02 05:24:17.898659 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 119/242] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:17 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1209 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:18.509528 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-87783373-77a2-4499-95ee-1934de0e77c5 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:18.510102 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-87783373-77a2-4499-95ee-1934de0e77c5 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:18.516500 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-87783373-77a2-4499-95ee-1934de0e77c5 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:18.517040 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-87783373-77a2-4499-95ee-1934de0e77c5 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:18.517510 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-87783373-77a2-4499-95ee-1934de0e77c5 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:18.518247 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-87783373-77a2-4499-95ee-1934de0e77c5 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:18.518721 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-87783373-77a2-4499-95ee-1934de0e77c5 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:18.519145 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-87783373-77a2-4499-95ee-1934de0e77c5 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:18.530856 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-e47c8352-2321-40dc-90a3-5441f69247c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:18.531466 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-e47c8352-2321-40dc-90a3-5441f69247c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:18.537403 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e47c8352-2321-40dc-90a3-5441f69247c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:18.537865 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e47c8352-2321-40dc-90a3-5441f69247c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:18.538312 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e47c8352-2321-40dc-90a3-5441f69247c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:18.538983 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e47c8352-2321-40dc-90a3-5441f69247c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:18.539401 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e47c8352-2321-40dc-90a3-5441f69247c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:18.539981 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e47c8352-2321-40dc-90a3-5441f69247c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:18.544250 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=100 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:18.962967 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e47c8352-2321-40dc-90a3-5441f69247c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:18.966789 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-87783373-77a2-4499-95ee-1934de0e77c5 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:18.974517 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-87783373-77a2-4499-95ee-1934de0e77c5 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.468995 Sep 02 05:24:18.975086 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 124/243] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:18 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:24:18.975215 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e47c8352-2321-40dc-90a3-5441f69247c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:18.976618 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e47c8352-2321-40dc-90a3-5441f69247c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:18.977917 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-e47c8352-2321-40dc-90a3-5441f69247c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1405 microversion: 2.20 time: 0.450903 Sep 02 05:24:18.978433 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 120/244] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:24:18 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1405 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:24:18.986842 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-99c4c853-e791-4684-9143-eb5cf78be9a6 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:18.987984 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-99c4c853-e791-4684-9143-eb5cf78be9a6 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:18.993031 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-1a9556bb-2a0f-4837-8933-d321f7920308 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:18.994072 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-1a9556bb-2a0f-4837-8933-d321f7920308 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:18.998720 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-99c4c853-e791-4684-9143-eb5cf78be9a6 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:18.999492 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-99c4c853-e791-4684-9143-eb5cf78be9a6 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:18.999763 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-99c4c853-e791-4684-9143-eb5cf78be9a6 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:19.000150 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1a9556bb-2a0f-4837-8933-d321f7920308 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:19.000650 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1a9556bb-2a0f-4837-8933-d321f7920308 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:19.000817 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-99c4c853-e791-4684-9143-eb5cf78be9a6 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:19.001077 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1a9556bb-2a0f-4837-8933-d321f7920308 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:19.001253 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-99c4c853-e791-4684-9143-eb5cf78be9a6 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:19.001497 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-99c4c853-e791-4684-9143-eb5cf78be9a6 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:19.001764 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1a9556bb-2a0f-4837-8933-d321f7920308 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:19.002236 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1a9556bb-2a0f-4837-8933-d321f7920308 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:19.002652 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1a9556bb-2a0f-4837-8933-d321f7920308 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:19.216600 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-99c4c853-e791-4684-9143-eb5cf78be9a6 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:19.216909 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-1a9556bb-2a0f-4837-8933-d321f7920308 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:19.225278 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-1a9556bb-2a0f-4837-8933-d321f7920308 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.248776 Sep 02 05:24:19.228445 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 125/245] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:18 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:19.228570 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-99c4c853-e791-4684-9143-eb5cf78be9a6 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.246844 Sep 02 05:24:19.228570 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 121/246] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:18 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:19.232201 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-1a4bb534-1f0e-4de0-8ccb-f6f6885e9109 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:19.232960 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-1a4bb534-1f0e-4de0-8ccb-f6f6885e9109 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:19.238908 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1a4bb534-1f0e-4de0-8ccb-f6f6885e9109 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:19.239380 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1a4bb534-1f0e-4de0-8ccb-f6f6885e9109 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:19.239804 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1a4bb534-1f0e-4de0-8ccb-f6f6885e9109 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:19.240571 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1a4bb534-1f0e-4de0-8ccb-f6f6885e9109 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:19.241602 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1a4bb534-1f0e-4de0-8ccb-f6f6885e9109 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:19.242018 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1a4bb534-1f0e-4de0-8ccb-f6f6885e9109 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:19.309489 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-1a4bb534-1f0e-4de0-8ccb-f6f6885e9109 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:19.317025 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-1a4bb534-1f0e-4de0-8ccb-f6f6885e9109 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1209 microversion: 2.1 time: 0.089804 Sep 02 05:24:19.317592 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 126/247] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:19 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1209 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:19.441361 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-66bdba80-b2a8-43c0-9ee7-e5b35114246b req-6c196550-ad79-41bd-8139-2364a74f2e8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47", "name": "network-vif-plugged", "status": "completed", "tag": "a32283d3-a932-4202-9e94-3dce7c235497"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:24:19.452012 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-66bdba80-b2a8-43c0-9ee7-e5b35114246b req-6c196550-ad79-41bd-8139-2364a74f2e8d service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:19.452443 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-66bdba80-b2a8-43c0-9ee7-e5b35114246b req-6c196550-ad79-41bd-8139-2364a74f2e8d service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:19.453493 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-66bdba80-b2a8-43c0-9ee7-e5b35114246b req-6c196550-ad79-41bd-8139-2364a74f2e8d service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:19.466034 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-66bdba80-b2a8-43c0-9ee7-e5b35114246b req-6c196550-ad79-41bd-8139-2364a74f2e8d service nova] Creating event network-vif-plugged:a32283d3-a932-4202-9e94-3dce7c235497 for instance 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 on hv-cinder-85391 Sep 02 05:24:19.473597 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-66bdba80-b2a8-43c0-9ee7-e5b35114246b req-6c196550-ad79-41bd-8139-2364a74f2e8d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036191 Sep 02 05:24:19.474755 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 122/248] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:24:19.998716 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-74fcd156-ebba-441a-bb49-5695c8f3d118 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:20.002348 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-74fcd156-ebba-441a-bb49-5695c8f3d118 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:20.003020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-555585ed-f362-402c-8627-dcf502710609 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:20.003702 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-555585ed-f362-402c-8627-dcf502710609 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:20.012972 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-555585ed-f362-402c-8627-dcf502710609 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:20.013625 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-555585ed-f362-402c-8627-dcf502710609 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:20.014186 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-555585ed-f362-402c-8627-dcf502710609 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:20.015046 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-555585ed-f362-402c-8627-dcf502710609 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:20.015627 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-555585ed-f362-402c-8627-dcf502710609 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:20.016366 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-555585ed-f362-402c-8627-dcf502710609 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:20.017116 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-74fcd156-ebba-441a-bb49-5695c8f3d118 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:20.017608 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-74fcd156-ebba-441a-bb49-5695c8f3d118 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:20.018096 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-74fcd156-ebba-441a-bb49-5695c8f3d118 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:20.018719 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-74fcd156-ebba-441a-bb49-5695c8f3d118 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:20.019168 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-74fcd156-ebba-441a-bb49-5695c8f3d118 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:20.020739 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-74fcd156-ebba-441a-bb49-5695c8f3d118 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:20.221280 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-74fcd156-ebba-441a-bb49-5695c8f3d118 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:20.229028 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-74fcd156-ebba-441a-bb49-5695c8f3d118 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.238043 Sep 02 05:24:20.229643 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 127/249] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:19 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:20.247370 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-67dc5542-5ca5-406c-ba4d-18ce06898a22 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:20.248355 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-67dc5542-5ca5-406c-ba4d-18ce06898a22 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:20.250403 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=100 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:20.255942 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-555585ed-f362-402c-8627-dcf502710609 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:20.260252 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-67dc5542-5ca5-406c-ba4d-18ce06898a22 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:20.260865 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-67dc5542-5ca5-406c-ba4d-18ce06898a22 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:20.261305 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-67dc5542-5ca5-406c-ba4d-18ce06898a22 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:20.261999 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-67dc5542-5ca5-406c-ba4d-18ce06898a22 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:20.262472 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-67dc5542-5ca5-406c-ba4d-18ce06898a22 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:20.262893 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-67dc5542-5ca5-406c-ba4d-18ce06898a22 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:20.264337 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-555585ed-f362-402c-8627-dcf502710609 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:20.265929 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-555585ed-f362-402c-8627-dcf502710609 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:20.267567 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-555585ed-f362-402c-8627-dcf502710609 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1405 microversion: 2.20 time: 0.268552 Sep 02 05:24:20.268616 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 123/250] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:24:19 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1405 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:24:20.273461 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ca2d2c4a-e3de-41d5-8568-0215f21f176d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:20.274261 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-ca2d2c4a-e3de-41d5-8568-0215f21f176d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:20.281273 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ca2d2c4a-e3de-41d5-8568-0215f21f176d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:20.281923 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ca2d2c4a-e3de-41d5-8568-0215f21f176d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:20.282794 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ca2d2c4a-e3de-41d5-8568-0215f21f176d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:20.284342 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ca2d2c4a-e3de-41d5-8568-0215f21f176d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:20.284869 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ca2d2c4a-e3de-41d5-8568-0215f21f176d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:20.285464 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ca2d2c4a-e3de-41d5-8568-0215f21f176d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:20.502983 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-67dc5542-5ca5-406c-ba4d-18ce06898a22 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:20.507300 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ca2d2c4a-e3de-41d5-8568-0215f21f176d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:20.512556 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-67dc5542-5ca5-406c-ba4d-18ce06898a22 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1321 microversion: 2.1 time: 0.270407 Sep 02 05:24:20.513492 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 128/251] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:20 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:20.520985 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-b0a16cc1-fa61-43e2-9855-142b781ce69f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:20.522316 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-b0a16cc1-fa61-43e2-9855-142b781ce69f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:20.522500 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-ca2d2c4a-e3de-41d5-8568-0215f21f176d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.252356 Sep 02 05:24:20.523063 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 124/252] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:20 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:20.531049 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b0a16cc1-fa61-43e2-9855-142b781ce69f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:20.531789 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b0a16cc1-fa61-43e2-9855-142b781ce69f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:20.532468 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b0a16cc1-fa61-43e2-9855-142b781ce69f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:20.533158 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b0a16cc1-fa61-43e2-9855-142b781ce69f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:20.533606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b0a16cc1-fa61-43e2-9855-142b781ce69f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:20.534171 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b0a16cc1-fa61-43e2-9855-142b781ce69f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:20.600327 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-b0a16cc1-fa61-43e2-9855-142b781ce69f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:20.608608 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-b0a16cc1-fa61-43e2-9855-142b781ce69f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1209 microversion: 2.1 time: 0.093494 Sep 02 05:24:20.609130 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 129/253] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:20 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1209 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:21.250777 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-4a8b9da7-c8bc-42b4-a0c0-55a77bbd325a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:21.251989 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-4a8b9da7-c8bc-42b4-a0c0-55a77bbd325a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:21.261818 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4a8b9da7-c8bc-42b4-a0c0-55a77bbd325a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:21.265137 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4a8b9da7-c8bc-42b4-a0c0-55a77bbd325a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:21.265582 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4a8b9da7-c8bc-42b4-a0c0-55a77bbd325a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:21.266296 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4a8b9da7-c8bc-42b4-a0c0-55a77bbd325a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:21.266752 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4a8b9da7-c8bc-42b4-a0c0-55a77bbd325a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:21.267173 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4a8b9da7-c8bc-42b4-a0c0-55a77bbd325a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:21.293350 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-cfdac039-b662-4f75-9b84-56356bdd4bbe tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:21.294935 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-cfdac039-b662-4f75-9b84-56356bdd4bbe tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:21.303426 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cfdac039-b662-4f75-9b84-56356bdd4bbe tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:21.304336 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cfdac039-b662-4f75-9b84-56356bdd4bbe tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:21.305049 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cfdac039-b662-4f75-9b84-56356bdd4bbe tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:21.306239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cfdac039-b662-4f75-9b84-56356bdd4bbe tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:21.306898 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cfdac039-b662-4f75-9b84-56356bdd4bbe tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:21.308041 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cfdac039-b662-4f75-9b84-56356bdd4bbe tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:21.577330 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-4a8b9da7-c8bc-42b4-a0c0-55a77bbd325a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:21.582847 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-cfdac039-b662-4f75-9b84-56356bdd4bbe tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:21.585315 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-4a8b9da7-c8bc-42b4-a0c0-55a77bbd325a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.339642 Sep 02 05:24:21.586456 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 125/254] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:21 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:21.591671 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5eb50bf6-2c15-442f-b776-f751e6ff24b9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:21.593120 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5eb50bf6-2c15-442f-b776-f751e6ff24b9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:21.599486 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5eb50bf6-2c15-442f-b776-f751e6ff24b9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:21.599958 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5eb50bf6-2c15-442f-b776-f751e6ff24b9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:21.600405 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5eb50bf6-2c15-442f-b776-f751e6ff24b9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:21.601280 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5eb50bf6-2c15-442f-b776-f751e6ff24b9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:21.601724 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5eb50bf6-2c15-442f-b776-f751e6ff24b9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:21.602285 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5eb50bf6-2c15-442f-b776-f751e6ff24b9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:21.606016 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-cfdac039-b662-4f75-9b84-56356bdd4bbe tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:21.608260 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-cfdac039-b662-4f75-9b84-56356bdd4bbe tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:21.609798 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-cfdac039-b662-4f75-9b84-56356bdd4bbe tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1405 microversion: 2.20 time: 0.321991 Sep 02 05:24:21.610517 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 130/255] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:24:21 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1405 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:24:21.628254 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-59c1ffd5-7ef8-44ea-b03e-f2dab62efa22 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:21.629125 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-59c1ffd5-7ef8-44ea-b03e-f2dab62efa22 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:21.642278 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-59c1ffd5-7ef8-44ea-b03e-f2dab62efa22 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:21.643698 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-59c1ffd5-7ef8-44ea-b03e-f2dab62efa22 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:21.644401 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-59c1ffd5-7ef8-44ea-b03e-f2dab62efa22 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:21.646053 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-59c1ffd5-7ef8-44ea-b03e-f2dab62efa22 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:21.647245 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-59c1ffd5-7ef8-44ea-b03e-f2dab62efa22 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:21.648214 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-59c1ffd5-7ef8-44ea-b03e-f2dab62efa22 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:21.847610 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-59c1ffd5-7ef8-44ea-b03e-f2dab62efa22 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:21.855757 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5eb50bf6-2c15-442f-b776-f751e6ff24b9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:21.857835 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-59c1ffd5-7ef8-44ea-b03e-f2dab62efa22 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1366 microversion: 2.1 time: 0.243474 Sep 02 05:24:21.859137 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 131/256] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:21 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:21.865512 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-22c2e97e-6f81-4880-8290-649c3e2f5f98 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:21.866597 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-22c2e97e-6f81-4880-8290-649c3e2f5f98 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:21.874498 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-22c2e97e-6f81-4880-8290-649c3e2f5f98 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:21.875326 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-22c2e97e-6f81-4880-8290-649c3e2f5f98 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:21.876020 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-22c2e97e-6f81-4880-8290-649c3e2f5f98 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:21.877962 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-22c2e97e-6f81-4880-8290-649c3e2f5f98 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:21.884917 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-22c2e97e-6f81-4880-8290-649c3e2f5f98 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:21.884917 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-22c2e97e-6f81-4880-8290-649c3e2f5f98 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:21.890870 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5eb50bf6-2c15-442f-b776-f751e6ff24b9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1516 microversion: 2.1 time: 0.302679 Sep 02 05:24:21.891561 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 126/257] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:21 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1516 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:21.911961 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-3a796213-59ab-4de7-9190-413a480d1fc2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:24:21.914254 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-3a796213-59ab-4de7-9190-413a480d1fc2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:21.921144 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3a796213-59ab-4de7-9190-413a480d1fc2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:21.921731 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3a796213-59ab-4de7-9190-413a480d1fc2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:21.922354 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3a796213-59ab-4de7-9190-413a480d1fc2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:21.928009 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3a796213-59ab-4de7-9190-413a480d1fc2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:21.929154 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3a796213-59ab-4de7-9190-413a480d1fc2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:21.929794 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3a796213-59ab-4de7-9190-413a480d1fc2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:21.953320 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-22c2e97e-6f81-4880-8290-649c3e2f5f98 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:21.961413 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-22c2e97e-6f81-4880-8290-649c3e2f5f98 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1209 microversion: 2.1 time: 0.101111 Sep 02 05:24:21.962244 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 132/258] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:21 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1209 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:21.998497 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.objects.instance [None req-3a796213-59ab-4de7-9190-413a480d1fc2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lazy-loading 'flavor' on Instance uuid 7ca0f78c-4691-4690-8772-c9fd6cfde418 {{(pid=120449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:24:22.125188 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-3a796213-59ab-4de7-9190-413a480d1fc2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "POST /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418/action" status: 200 len: 32 microversion: 2.1 time: 0.216962 Sep 02 05:24:22.126413 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 127/259] 10.222.0.30 () {60 vars in 1278 bytes} [Fri Sep 2 05:24:21 2022] POST /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418/action => generated 32 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 02 05:24:22.137489 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-607c651c-7f55-4b2d-9a79-f796df4d8147 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:22.138252 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-607c651c-7f55-4b2d-9a79-f796df4d8147 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:22.144828 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-607c651c-7f55-4b2d-9a79-f796df4d8147 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:22.145309 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-607c651c-7f55-4b2d-9a79-f796df4d8147 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:22.145740 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-607c651c-7f55-4b2d-9a79-f796df4d8147 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:22.146426 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-607c651c-7f55-4b2d-9a79-f796df4d8147 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:22.146871 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-607c651c-7f55-4b2d-9a79-f796df4d8147 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:22.147357 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-607c651c-7f55-4b2d-9a79-f796df4d8147 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:22.281850 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-607c651c-7f55-4b2d-9a79-f796df4d8147 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:22.291203 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-607c651c-7f55-4b2d-9a79-f796df4d8147 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.158423 Sep 02 05:24:22.292086 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 133/260] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:22 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:22.609899 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-62b39a35-6c24-4672-9c3f-e17026bc7e6c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:22.611155 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-62b39a35-6c24-4672-9c3f-e17026bc7e6c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:22.619096 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-62b39a35-6c24-4672-9c3f-e17026bc7e6c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:22.619579 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-62b39a35-6c24-4672-9c3f-e17026bc7e6c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:22.620276 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-62b39a35-6c24-4672-9c3f-e17026bc7e6c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:22.620846 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-62b39a35-6c24-4672-9c3f-e17026bc7e6c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:22.621291 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-62b39a35-6c24-4672-9c3f-e17026bc7e6c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:22.621728 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-62b39a35-6c24-4672-9c3f-e17026bc7e6c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:22.636359 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-5336a7d4-9d12-4928-b17d-37268f4eda03 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:22.637953 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-5336a7d4-9d12-4928-b17d-37268f4eda03 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:22.646300 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5336a7d4-9d12-4928-b17d-37268f4eda03 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:22.647529 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5336a7d4-9d12-4928-b17d-37268f4eda03 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:22.648364 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5336a7d4-9d12-4928-b17d-37268f4eda03 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:22.649523 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5336a7d4-9d12-4928-b17d-37268f4eda03 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:22.650194 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5336a7d4-9d12-4928-b17d-37268f4eda03 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:22.650823 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5336a7d4-9d12-4928-b17d-37268f4eda03 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:22.822687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-62b39a35-6c24-4672-9c3f-e17026bc7e6c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:22.832865 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-62b39a35-6c24-4672-9c3f-e17026bc7e6c tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.228362 Sep 02 05:24:22.848473 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 128/261] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:22 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:22.859375 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-5336a7d4-9d12-4928-b17d-37268f4eda03 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:22.870561 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-5336a7d4-9d12-4928-b17d-37268f4eda03 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:22.872328 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-5336a7d4-9d12-4928-b17d-37268f4eda03 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:22.873926 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-5336a7d4-9d12-4928-b17d-37268f4eda03 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1405 microversion: 2.20 time: 0.242198 Sep 02 05:24:22.874894 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 134/262] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:24:22 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1405 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:24:22.884540 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-a062db48-d610-4285-a7b5-57031fa0191a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:22.884950 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-a062db48-d610-4285-a7b5-57031fa0191a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:22.891495 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a062db48-d610-4285-a7b5-57031fa0191a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:22.891981 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a062db48-d610-4285-a7b5-57031fa0191a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:22.895488 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a062db48-d610-4285-a7b5-57031fa0191a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:22.896310 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a062db48-d610-4285-a7b5-57031fa0191a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:22.896779 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a062db48-d610-4285-a7b5-57031fa0191a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:22.897209 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a062db48-d610-4285-a7b5-57031fa0191a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:22.982732 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-9d64ce98-cc85-47ae-aa18-f88de86ab9a7 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:22.983514 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-9d64ce98-cc85-47ae-aa18-f88de86ab9a7 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:22.991282 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9d64ce98-cc85-47ae-aa18-f88de86ab9a7 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:22.997504 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9d64ce98-cc85-47ae-aa18-f88de86ab9a7 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:22.998115 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9d64ce98-cc85-47ae-aa18-f88de86ab9a7 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:22.999000 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9d64ce98-cc85-47ae-aa18-f88de86ab9a7 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:22.999457 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9d64ce98-cc85-47ae-aa18-f88de86ab9a7 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:22.999987 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9d64ce98-cc85-47ae-aa18-f88de86ab9a7 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:23.085972 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-a062db48-d610-4285-a7b5-57031fa0191a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:23.101243 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-a062db48-d610-4285-a7b5-57031fa0191a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1555 microversion: 2.1 time: 0.221534 Sep 02 05:24:23.102256 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 129/263] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:22 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1555 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:24:23.132885 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-4d8691e3-7325-4a23-bdec-7de6a9dbd50e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:23.133657 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-4d8691e3-7325-4a23-bdec-7de6a9dbd50e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:23.145732 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4d8691e3-7325-4a23-bdec-7de6a9dbd50e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:23.146485 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4d8691e3-7325-4a23-bdec-7de6a9dbd50e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:23.147661 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4d8691e3-7325-4a23-bdec-7de6a9dbd50e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:23.148553 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-9d64ce98-cc85-47ae-aa18-f88de86ab9a7 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:23.149312 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4d8691e3-7325-4a23-bdec-7de6a9dbd50e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:23.150001 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4d8691e3-7325-4a23-bdec-7de6a9dbd50e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:23.150608 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4d8691e3-7325-4a23-bdec-7de6a9dbd50e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:23.163186 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-9d64ce98-cc85-47ae-aa18-f88de86ab9a7 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1209 microversion: 2.1 time: 0.184119 Sep 02 05:24:23.164414 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 135/264] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:22 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1209 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:23.245701 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-4d8691e3-7325-4a23-bdec-7de6a9dbd50e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117288 Sep 02 05:24:23.246508 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 130/265] 10.222.0.30 () {58 vars in 1275 bytes} [Fri Sep 2 05:24:23 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:24:23.311979 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-53747953-1a8e-4993-8082-dd32e2bd9b04 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:23.312737 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-53747953-1a8e-4993-8082-dd32e2bd9b04 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:23.324234 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-53747953-1a8e-4993-8082-dd32e2bd9b04 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:23.324974 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-53747953-1a8e-4993-8082-dd32e2bd9b04 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:23.325657 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-53747953-1a8e-4993-8082-dd32e2bd9b04 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:23.340463 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-53747953-1a8e-4993-8082-dd32e2bd9b04 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:23.344159 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-53747953-1a8e-4993-8082-dd32e2bd9b04 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:23.344708 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-53747953-1a8e-4993-8082-dd32e2bd9b04 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:23.702982 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-53747953-1a8e-4993-8082-dd32e2bd9b04 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:23.712539 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-53747953-1a8e-4993-8082-dd32e2bd9b04 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.404091 Sep 02 05:24:23.713491 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 136/266] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:23 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:23.853662 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-426ec347-fea3-41ac-836f-a620274c4b89 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:23.854832 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-426ec347-fea3-41ac-836f-a620274c4b89 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:23.861243 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-426ec347-fea3-41ac-836f-a620274c4b89 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:23.861966 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-426ec347-fea3-41ac-836f-a620274c4b89 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:23.862394 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-426ec347-fea3-41ac-836f-a620274c4b89 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:23.863082 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-426ec347-fea3-41ac-836f-a620274c4b89 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:23.863501 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-426ec347-fea3-41ac-836f-a620274c4b89 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:23.864106 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-426ec347-fea3-41ac-836f-a620274c4b89 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:23.899093 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-e8fd1d9c-80ca-49e5-95ab-9f3634fb8254 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:23.900018 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-e8fd1d9c-80ca-49e5-95ab-9f3634fb8254 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:23.907711 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e8fd1d9c-80ca-49e5-95ab-9f3634fb8254 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:23.908350 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e8fd1d9c-80ca-49e5-95ab-9f3634fb8254 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:23.908902 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e8fd1d9c-80ca-49e5-95ab-9f3634fb8254 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:23.910118 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e8fd1d9c-80ca-49e5-95ab-9f3634fb8254 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:23.910769 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e8fd1d9c-80ca-49e5-95ab-9f3634fb8254 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:23.911252 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e8fd1d9c-80ca-49e5-95ab-9f3634fb8254 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:24.573247 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-426ec347-fea3-41ac-836f-a620274c4b89 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:24.587818 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-426ec347-fea3-41ac-836f-a620274c4b89 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.737517 Sep 02 05:24:24.588926 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 131/267] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:23 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:24.601524 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-76f95df6-fb08-4c81-83a8-2f08e221b1b0 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:24.603857 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-76f95df6-fb08-4c81-83a8-2f08e221b1b0 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:24.607810 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-e8fd1d9c-80ca-49e5-95ab-9f3634fb8254 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:24.615324 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_api:SELECT=100 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:24.616753 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-76f95df6-fb08-4c81-83a8-2f08e221b1b0 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:24.617195 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-e8fd1d9c-80ca-49e5-95ab-9f3634fb8254 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:24.617810 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-76f95df6-fb08-4c81-83a8-2f08e221b1b0 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:24.620054 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-e8fd1d9c-80ca-49e5-95ab-9f3634fb8254 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:24.621092 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-76f95df6-fb08-4c81-83a8-2f08e221b1b0 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:24.621847 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-76f95df6-fb08-4c81-83a8-2f08e221b1b0 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:24.622096 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-e8fd1d9c-80ca-49e5-95ab-9f3634fb8254 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1596 microversion: 2.20 time: 0.729715 Sep 02 05:24:24.623231 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 137/268] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:24:23 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1596 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:24:24.637942 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-76f95df6-fb08-4c81-83a8-2f08e221b1b0 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:24.638810 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-76f95df6-fb08-4c81-83a8-2f08e221b1b0 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:24.652313 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-354c37d9-c74e-4924-844a-0f132ae844b3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:24.653129 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-354c37d9-c74e-4924-844a-0f132ae844b3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:24.663134 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-354c37d9-c74e-4924-844a-0f132ae844b3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:24.666322 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-354c37d9-c74e-4924-844a-0f132ae844b3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:24.667268 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-354c37d9-c74e-4924-844a-0f132ae844b3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:24.668398 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-354c37d9-c74e-4924-844a-0f132ae844b3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:24.669422 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-354c37d9-c74e-4924-844a-0f132ae844b3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:24.676289 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-354c37d9-c74e-4924-844a-0f132ae844b3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:24.745504 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-76f95df6-fb08-4c81-83a8-2f08e221b1b0 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:24.755761 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-76f95df6-fb08-4c81-83a8-2f08e221b1b0 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1209 microversion: 2.1 time: 0.162327 Sep 02 05:24:24.765413 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 132/269] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:24 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1209 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:24.773095 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-e92d5891-5b38-48bb-a788-7744c58ec80b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:24.773701 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-e92d5891-5b38-48bb-a788-7744c58ec80b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:24.782955 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e92d5891-5b38-48bb-a788-7744c58ec80b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:24.783447 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e92d5891-5b38-48bb-a788-7744c58ec80b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:24.783881 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e92d5891-5b38-48bb-a788-7744c58ec80b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:24.784863 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e92d5891-5b38-48bb-a788-7744c58ec80b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:24.785317 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e92d5891-5b38-48bb-a788-7744c58ec80b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:24.785882 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e92d5891-5b38-48bb-a788-7744c58ec80b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:24.840111 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-354c37d9-c74e-4924-844a-0f132ae844b3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.191411 Sep 02 05:24:24.840776 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 138/270] 10.222.0.30 () {60 vars in 1316 bytes} [Fri Sep 2 05:24:24 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d/os-interface => generated 284 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 05:24:25.183400 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e92d5891-5b38-48bb-a788-7744c58ec80b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:25.194998 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-e92d5891-5b38-48bb-a788-7744c58ec80b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.428117 Sep 02 05:24:25.196246 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 133/271] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:24 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:25.608540 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-38846794-a214-471c-a452-860d36f9bc45 req-92abdfb7-007b-4dd3-aace-945c5a72ace7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ecefc31-2d93-4601-91e7-0d18da502d8b", "tag": "5c422bbe-4e68-47eb-b4b1-26e72bf162b6"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:24:25.612030 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ea88a737-fa4d-4880-a63a-65304fb5acf2 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:25.612965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-ea88a737-fa4d-4880-a63a-65304fb5acf2 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:25.624670 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ea88a737-fa4d-4880-a63a-65304fb5acf2 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:25.625039 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-38846794-a214-471c-a452-860d36f9bc45 req-92abdfb7-007b-4dd3-aace-945c5a72ace7 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:25.625519 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-38846794-a214-471c-a452-860d36f9bc45 req-92abdfb7-007b-4dd3-aace-945c5a72ace7 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:25.625947 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-38846794-a214-471c-a452-860d36f9bc45 req-92abdfb7-007b-4dd3-aace-945c5a72ace7 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:25.626238 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ea88a737-fa4d-4880-a63a-65304fb5acf2 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:25.627489 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ea88a737-fa4d-4880-a63a-65304fb5acf2 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:25.628563 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ea88a737-fa4d-4880-a63a-65304fb5acf2 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:25.629206 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ea88a737-fa4d-4880-a63a-65304fb5acf2 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:25.629811 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ea88a737-fa4d-4880-a63a-65304fb5acf2 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:25.644865 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=100 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:25.647940 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-38846794-a214-471c-a452-860d36f9bc45 req-92abdfb7-007b-4dd3-aace-945c5a72ace7 service nova] Creating event network-changed:5c422bbe-4e68-47eb-b4b1-26e72bf162b6 for instance 6ecefc31-2d93-4601-91e7-0d18da502d8b on hv-cinder-85391 Sep 02 05:24:25.655770 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-38846794-a214-471c-a452-860d36f9bc45 req-92abdfb7-007b-4dd3-aace-945c5a72ace7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053280 Sep 02 05:24:25.656410 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 139/272] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:24:25.777601 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-0e43af6d-d568-4e23-8fe1-c9acd21516ec tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:25.778203 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-0e43af6d-d568-4e23-8fe1-c9acd21516ec tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:25.793715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0e43af6d-d568-4e23-8fe1-c9acd21516ec tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:25.794204 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0e43af6d-d568-4e23-8fe1-c9acd21516ec tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:25.794637 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0e43af6d-d568-4e23-8fe1-c9acd21516ec tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:25.795332 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0e43af6d-d568-4e23-8fe1-c9acd21516ec tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:25.799127 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0e43af6d-d568-4e23-8fe1-c9acd21516ec tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:25.799585 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0e43af6d-d568-4e23-8fe1-c9acd21516ec tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:25.883654 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ea88a737-fa4d-4880-a63a-65304fb5acf2 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:25.896647 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-ea88a737-fa4d-4880-a63a-65304fb5acf2 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.290740 Sep 02 05:24:25.897234 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 134/273] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:25 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:25.925044 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-0e43af6d-d568-4e23-8fe1-c9acd21516ec tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:25.933440 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-0e43af6d-d568-4e23-8fe1-c9acd21516ec tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1265 microversion: 2.1 time: 0.160248 Sep 02 05:24:25.944491 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 140/274] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:25 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:26.217904 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-33263dca-b2ec-4765-8a15-4953dbbc3fb4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:26.219503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-33263dca-b2ec-4765-8a15-4953dbbc3fb4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:26.231806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-33263dca-b2ec-4765-8a15-4953dbbc3fb4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:26.232901 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-33263dca-b2ec-4765-8a15-4953dbbc3fb4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:26.233520 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-33263dca-b2ec-4765-8a15-4953dbbc3fb4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:26.234369 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-33263dca-b2ec-4765-8a15-4953dbbc3fb4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:26.234969 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-33263dca-b2ec-4765-8a15-4953dbbc3fb4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:26.235636 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-33263dca-b2ec-4765-8a15-4953dbbc3fb4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:26.473217 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-33263dca-b2ec-4765-8a15-4953dbbc3fb4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:26.491578 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:26.519476 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-33263dca-b2ec-4765-8a15-4953dbbc3fb4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.304545 Sep 02 05:24:26.520131 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 135/275] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:26 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:26.525312 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-d897220b-812b-4734-bed4-9fc2c484839f req-7864c30f-a8a2-404d-9487-dbcd6a428ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e32b402-d6f2-4861-a864-005e1a9f808d", "tag": "26f374c2-ecf9-4064-b5ad-13f47d97521e"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:24:26.535435 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-d897220b-812b-4734-bed4-9fc2c484839f req-7864c30f-a8a2-404d-9487-dbcd6a428ba3 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:26.538898 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-d897220b-812b-4734-bed4-9fc2c484839f req-7864c30f-a8a2-404d-9487-dbcd6a428ba3 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:26.540555 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-d897220b-812b-4734-bed4-9fc2c484839f req-7864c30f-a8a2-404d-9487-dbcd6a428ba3 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:26.562017 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-d897220b-812b-4734-bed4-9fc2c484839f req-7864c30f-a8a2-404d-9487-dbcd6a428ba3 service nova] Creating event network-changed:26f374c2-ecf9-4064-b5ad-13f47d97521e for instance 1e32b402-d6f2-4861-a864-005e1a9f808d on hv-cinder-85391 Sep 02 05:24:26.568984 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-d897220b-812b-4734-bed4-9fc2c484839f req-7864c30f-a8a2-404d-9487-dbcd6a428ba3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047541 Sep 02 05:24:26.570191 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 141/276] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:24:26.918303 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-59d80b1d-4524-411b-b075-4dbed14310c7 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:26.919281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-59d80b1d-4524-411b-b075-4dbed14310c7 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:26.935868 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-59d80b1d-4524-411b-b075-4dbed14310c7 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:26.936446 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-59d80b1d-4524-411b-b075-4dbed14310c7 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:26.937621 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-59d80b1d-4524-411b-b075-4dbed14310c7 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:26.939357 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-59d80b1d-4524-411b-b075-4dbed14310c7 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:26.940017 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-59d80b1d-4524-411b-b075-4dbed14310c7 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:26.955516 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d1a411d3-73fd-46f8-a90d-c84fc4b30fcf tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:26.956791 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-d1a411d3-73fd-46f8-a90d-c84fc4b30fcf tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:26.959901 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-59d80b1d-4524-411b-b075-4dbed14310c7 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:26.969912 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d1a411d3-73fd-46f8-a90d-c84fc4b30fcf tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:26.970400 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d1a411d3-73fd-46f8-a90d-c84fc4b30fcf tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:26.971497 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d1a411d3-73fd-46f8-a90d-c84fc4b30fcf tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:26.972919 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d1a411d3-73fd-46f8-a90d-c84fc4b30fcf tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:26.973521 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d1a411d3-73fd-46f8-a90d-c84fc4b30fcf tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:26.974097 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d1a411d3-73fd-46f8-a90d-c84fc4b30fcf tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:27.104987 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d1a411d3-73fd-46f8-a90d-c84fc4b30fcf tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:27.114602 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-d1a411d3-73fd-46f8-a90d-c84fc4b30fcf tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1265 microversion: 2.1 time: 0.163308 Sep 02 05:24:27.131315 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 142/277] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:26 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:27.224540 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-59d80b1d-4524-411b-b075-4dbed14310c7 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:27.233785 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-59d80b1d-4524-411b-b075-4dbed14310c7 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.320229 Sep 02 05:24:27.234813 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 136/278] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:26 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:27.540535 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-82b19f8f-34c5-4f42-b3a7-7a0d57288690 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:27.541547 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-82b19f8f-34c5-4f42-b3a7-7a0d57288690 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:27.551007 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-82b19f8f-34c5-4f42-b3a7-7a0d57288690 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:27.552806 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-82b19f8f-34c5-4f42-b3a7-7a0d57288690 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:27.554759 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-82b19f8f-34c5-4f42-b3a7-7a0d57288690 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:27.556461 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-82b19f8f-34c5-4f42-b3a7-7a0d57288690 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:27.557138 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-82b19f8f-34c5-4f42-b3a7-7a0d57288690 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:27.566463 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-82b19f8f-34c5-4f42-b3a7-7a0d57288690 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:27.735927 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-82b19f8f-34c5-4f42-b3a7-7a0d57288690 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:27.743725 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-82b19f8f-34c5-4f42-b3a7-7a0d57288690 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.207078 Sep 02 05:24:27.744332 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 143/279] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:27 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:24:28.138394 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-cfd8f457-6012-43d8-9658-85aa6f82b0b2 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:28.139512 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-cfd8f457-6012-43d8-9658-85aa6f82b0b2 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:28.146389 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cfd8f457-6012-43d8-9658-85aa6f82b0b2 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:28.146890 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cfd8f457-6012-43d8-9658-85aa6f82b0b2 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:28.147316 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cfd8f457-6012-43d8-9658-85aa6f82b0b2 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:28.148014 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cfd8f457-6012-43d8-9658-85aa6f82b0b2 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:28.148488 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cfd8f457-6012-43d8-9658-85aa6f82b0b2 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:28.148901 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cfd8f457-6012-43d8-9658-85aa6f82b0b2 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:28.226117 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-cfd8f457-6012-43d8-9658-85aa6f82b0b2 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:28.241417 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-cfd8f457-6012-43d8-9658-85aa6f82b0b2 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1265 microversion: 2.1 time: 0.106922 Sep 02 05:24:28.247402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 137/280] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:28 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1265 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:28.255185 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-ff582962-4643-4a8f-9579-38c934400e56 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:28.256335 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-ff582962-4643-4a8f-9579-38c934400e56 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:28.263128 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ff582962-4643-4a8f-9579-38c934400e56 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:28.267968 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ff582962-4643-4a8f-9579-38c934400e56 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:28.268306 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ff582962-4643-4a8f-9579-38c934400e56 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:28.269056 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ff582962-4643-4a8f-9579-38c934400e56 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:28.269501 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ff582962-4643-4a8f-9579-38c934400e56 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:28.271801 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ff582962-4643-4a8f-9579-38c934400e56 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:28.420386 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-ff582962-4643-4a8f-9579-38c934400e56 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:28.428244 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-ff582962-4643-4a8f-9579-38c934400e56 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.177363 Sep 02 05:24:28.428813 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 144/281] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:28 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:28.766746 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-b9921434-3b3d-4947-b0e9-f7e38618c18e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:28.767390 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-b9921434-3b3d-4947-b0e9-f7e38618c18e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:28.773544 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b9921434-3b3d-4947-b0e9-f7e38618c18e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:28.774355 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b9921434-3b3d-4947-b0e9-f7e38618c18e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:28.774513 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b9921434-3b3d-4947-b0e9-f7e38618c18e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:28.775160 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b9921434-3b3d-4947-b0e9-f7e38618c18e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:28.775646 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b9921434-3b3d-4947-b0e9-f7e38618c18e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:28.776099 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b9921434-3b3d-4947-b0e9-f7e38618c18e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:28.922081 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-b9921434-3b3d-4947-b0e9-f7e38618c18e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:28.930332 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-b9921434-3b3d-4947-b0e9-f7e38618c18e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.167542 Sep 02 05:24:28.930906 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 138/282] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:28 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:29.270455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-b0c8e5fe-8f58-4706-ab0f-97eda019ffe9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:29.271173 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-b0c8e5fe-8f58-4706-ab0f-97eda019ffe9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:29.277432 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b0c8e5fe-8f58-4706-ab0f-97eda019ffe9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:29.278124 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b0c8e5fe-8f58-4706-ab0f-97eda019ffe9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:29.279149 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b0c8e5fe-8f58-4706-ab0f-97eda019ffe9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:29.279846 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b0c8e5fe-8f58-4706-ab0f-97eda019ffe9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:29.280623 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b0c8e5fe-8f58-4706-ab0f-97eda019ffe9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:29.280863 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b0c8e5fe-8f58-4706-ab0f-97eda019ffe9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:29.347714 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-b0c8e5fe-8f58-4706-ab0f-97eda019ffe9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:29.355845 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-b0c8e5fe-8f58-4706-ab0f-97eda019ffe9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1265 microversion: 2.1 time: 0.089209 Sep 02 05:24:29.356442 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 145/283] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:29 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1265 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:29.448338 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-0f945b72-451d-4d31-850a-0b1cc2222185 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:29.449497 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-0f945b72-451d-4d31-850a-0b1cc2222185 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:29.455850 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0f945b72-451d-4d31-850a-0b1cc2222185 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:29.456608 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0f945b72-451d-4d31-850a-0b1cc2222185 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:29.457213 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0f945b72-451d-4d31-850a-0b1cc2222185 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:29.458129 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0f945b72-451d-4d31-850a-0b1cc2222185 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:29.458642 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0f945b72-451d-4d31-850a-0b1cc2222185 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:29.459091 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0f945b72-451d-4d31-850a-0b1cc2222185 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:29.605921 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-0f945b72-451d-4d31-850a-0b1cc2222185 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:29.616316 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-0f945b72-451d-4d31-850a-0b1cc2222185 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.171763 Sep 02 05:24:29.621375 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 139/284] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:29 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:29.951723 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-eb87d7e5-c8e4-4c80-b4c5-136b52681b43 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:29.952864 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-eb87d7e5-c8e4-4c80-b4c5-136b52681b43 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:29.961659 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eb87d7e5-c8e4-4c80-b4c5-136b52681b43 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:29.963672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eb87d7e5-c8e4-4c80-b4c5-136b52681b43 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:29.964469 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eb87d7e5-c8e4-4c80-b4c5-136b52681b43 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:29.965391 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eb87d7e5-c8e4-4c80-b4c5-136b52681b43 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:29.966236 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eb87d7e5-c8e4-4c80-b4c5-136b52681b43 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:29.982708 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eb87d7e5-c8e4-4c80-b4c5-136b52681b43 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:30.164437 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-eb87d7e5-c8e4-4c80-b4c5-136b52681b43 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:30.172887 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-eb87d7e5-c8e4-4c80-b4c5-136b52681b43 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.225797 Sep 02 05:24:30.173473 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 146/285] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:29 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:30.378289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-f4891b59-0c59-40d7-bc8b-be6dd641309c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:30.379072 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-f4891b59-0c59-40d7-bc8b-be6dd641309c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:30.386428 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f4891b59-0c59-40d7-bc8b-be6dd641309c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:30.386883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f4891b59-0c59-40d7-bc8b-be6dd641309c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:30.387340 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f4891b59-0c59-40d7-bc8b-be6dd641309c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:30.388026 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f4891b59-0c59-40d7-bc8b-be6dd641309c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:30.388857 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f4891b59-0c59-40d7-bc8b-be6dd641309c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:30.388979 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f4891b59-0c59-40d7-bc8b-be6dd641309c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:30.454437 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-f4891b59-0c59-40d7-bc8b-be6dd641309c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:30.462111 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-f4891b59-0c59-40d7-bc8b-be6dd641309c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1265 microversion: 2.1 time: 0.088247 Sep 02 05:24:30.462763 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 140/286] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:30 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1265 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:30.640915 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-70e6122c-cc90-4017-a007-b977c6752c79 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:30.641515 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-70e6122c-cc90-4017-a007-b977c6752c79 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:30.647668 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-70e6122c-cc90-4017-a007-b977c6752c79 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:30.648171 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-70e6122c-cc90-4017-a007-b977c6752c79 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:30.648685 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-70e6122c-cc90-4017-a007-b977c6752c79 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:30.649363 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-70e6122c-cc90-4017-a007-b977c6752c79 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:30.649803 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-70e6122c-cc90-4017-a007-b977c6752c79 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:30.650220 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-70e6122c-cc90-4017-a007-b977c6752c79 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:30.893395 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-70e6122c-cc90-4017-a007-b977c6752c79 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:30.901168 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-70e6122c-cc90-4017-a007-b977c6752c79 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1314 microversion: 2.1 time: 0.263947 Sep 02 05:24:30.901734 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 147/287] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:30 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:31.198161 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-91d4fcb7-6bdf-45ab-9e47-070de012c0e6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:31.198743 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-91d4fcb7-6bdf-45ab-9e47-070de012c0e6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:31.204895 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-91d4fcb7-6bdf-45ab-9e47-070de012c0e6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:31.205314 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-91d4fcb7-6bdf-45ab-9e47-070de012c0e6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:31.205744 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-91d4fcb7-6bdf-45ab-9e47-070de012c0e6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:31.206444 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-91d4fcb7-6bdf-45ab-9e47-070de012c0e6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:31.206889 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-91d4fcb7-6bdf-45ab-9e47-070de012c0e6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:31.207304 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-91d4fcb7-6bdf-45ab-9e47-070de012c0e6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:31.334469 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-91d4fcb7-6bdf-45ab-9e47-070de012c0e6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:31.342637 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-91d4fcb7-6bdf-45ab-9e47-070de012c0e6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.151496 Sep 02 05:24:31.343209 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 141/288] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:31 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:31.485371 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-75484195-32f7-4a5d-958c-25cac174c592 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:31.486125 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-75484195-32f7-4a5d-958c-25cac174c592 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:31.496224 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-75484195-32f7-4a5d-958c-25cac174c592 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:31.496784 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-75484195-32f7-4a5d-958c-25cac174c592 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:31.497320 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-75484195-32f7-4a5d-958c-25cac174c592 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:31.498361 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-75484195-32f7-4a5d-958c-25cac174c592 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:31.499017 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-75484195-32f7-4a5d-958c-25cac174c592 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:31.499814 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-75484195-32f7-4a5d-958c-25cac174c592 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:31.583748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-75484195-32f7-4a5d-958c-25cac174c592 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:31.596407 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-75484195-32f7-4a5d-958c-25cac174c592 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1283 microversion: 2.1 time: 0.117419 Sep 02 05:24:31.597249 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 148/289] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:31 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1283 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:31.921754 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-b0c7a824-05a7-416a-99fa-25852945892a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:31.922353 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-b0c7a824-05a7-416a-99fa-25852945892a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:31.928451 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b0c7a824-05a7-416a-99fa-25852945892a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:31.928920 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b0c7a824-05a7-416a-99fa-25852945892a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:31.929343 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b0c7a824-05a7-416a-99fa-25852945892a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:31.930012 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b0c7a824-05a7-416a-99fa-25852945892a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:31.930483 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b0c7a824-05a7-416a-99fa-25852945892a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:31.930901 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b0c7a824-05a7-416a-99fa-25852945892a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:32.182476 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-b0c7a824-05a7-416a-99fa-25852945892a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:32.195369 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-b0c7a824-05a7-416a-99fa-25852945892a tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1502 microversion: 2.1 time: 0.277279 Sep 02 05:24:32.195958 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 142/290] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:31 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1502 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:32.363503 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-e09beb92-d266-491c-ac86-b4f21b53feaa tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:32.364590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-e09beb92-d266-491c-ac86-b4f21b53feaa tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:32.371254 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e09beb92-d266-491c-ac86-b4f21b53feaa tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:32.371973 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e09beb92-d266-491c-ac86-b4f21b53feaa tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:32.372433 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e09beb92-d266-491c-ac86-b4f21b53feaa tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:32.373151 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e09beb92-d266-491c-ac86-b4f21b53feaa tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:32.373571 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e09beb92-d266-491c-ac86-b4f21b53feaa tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:32.374155 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e09beb92-d266-491c-ac86-b4f21b53feaa tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:32.511076 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-e09beb92-d266-491c-ac86-b4f21b53feaa tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:32.520037 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-e09beb92-d266-491c-ac86-b4f21b53feaa tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.160813 Sep 02 05:24:32.533952 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 149/291] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:32 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:32.619102 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-8cb2d9b0-8088-4a18-b0b9-7af06302c067 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:32.619758 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-8cb2d9b0-8088-4a18-b0b9-7af06302c067 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:32.626302 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8cb2d9b0-8088-4a18-b0b9-7af06302c067 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:32.626797 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8cb2d9b0-8088-4a18-b0b9-7af06302c067 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:32.627229 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8cb2d9b0-8088-4a18-b0b9-7af06302c067 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:32.627920 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8cb2d9b0-8088-4a18-b0b9-7af06302c067 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:32.628394 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8cb2d9b0-8088-4a18-b0b9-7af06302c067 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:32.628812 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8cb2d9b0-8088-4a18-b0b9-7af06302c067 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:32.774577 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-8cb2d9b0-8088-4a18-b0b9-7af06302c067 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:32.783264 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-8cb2d9b0-8088-4a18-b0b9-7af06302c067 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1313 microversion: 2.1 time: 0.169030 Sep 02 05:24:32.783754 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 143/292] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:32 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:24:33.541273 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-879e3e2b-9941-4a52-9a7c-f412fe1ad285 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:33.541826 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-879e3e2b-9941-4a52-9a7c-f412fe1ad285 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:33.548569 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-879e3e2b-9941-4a52-9a7c-f412fe1ad285 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:33.549053 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-879e3e2b-9941-4a52-9a7c-f412fe1ad285 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:33.549491 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-879e3e2b-9941-4a52-9a7c-f412fe1ad285 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:33.550183 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-879e3e2b-9941-4a52-9a7c-f412fe1ad285 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:33.550628 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-879e3e2b-9941-4a52-9a7c-f412fe1ad285 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:33.551049 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-879e3e2b-9941-4a52-9a7c-f412fe1ad285 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:33.684524 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-879e3e2b-9941-4a52-9a7c-f412fe1ad285 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:33.692646 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-879e3e2b-9941-4a52-9a7c-f412fe1ad285 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.155434 Sep 02 05:24:33.693208 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 150/293] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:33 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:33.808315 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5a1e4521-6ba1-4e98-ba63-83bdbb390d49 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:33.808911 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5a1e4521-6ba1-4e98-ba63-83bdbb390d49 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:33.816070 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5a1e4521-6ba1-4e98-ba63-83bdbb390d49 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:33.816651 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5a1e4521-6ba1-4e98-ba63-83bdbb390d49 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:33.817130 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5a1e4521-6ba1-4e98-ba63-83bdbb390d49 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:33.817882 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5a1e4521-6ba1-4e98-ba63-83bdbb390d49 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:33.818380 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5a1e4521-6ba1-4e98-ba63-83bdbb390d49 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:33.818847 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5a1e4521-6ba1-4e98-ba63-83bdbb390d49 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:34.108411 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5a1e4521-6ba1-4e98-ba63-83bdbb390d49 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:34.116465 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5a1e4521-6ba1-4e98-ba63-83bdbb390d49 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1313 microversion: 2.1 time: 0.314721 Sep 02 05:24:34.117042 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 144/294] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:33 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:34.714499 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-41746c94-5bc3-4b15-9590-4cab18883f19 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:34.715126 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-41746c94-5bc3-4b15-9590-4cab18883f19 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:34.721437 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-41746c94-5bc3-4b15-9590-4cab18883f19 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:34.721918 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-41746c94-5bc3-4b15-9590-4cab18883f19 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:34.722342 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-41746c94-5bc3-4b15-9590-4cab18883f19 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:34.723003 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-41746c94-5bc3-4b15-9590-4cab18883f19 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:34.723471 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-41746c94-5bc3-4b15-9590-4cab18883f19 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:34.723884 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-41746c94-5bc3-4b15-9590-4cab18883f19 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:34.852752 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-41746c94-5bc3-4b15-9590-4cab18883f19 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:34.861138 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-41746c94-5bc3-4b15-9590-4cab18883f19 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.150527 Sep 02 05:24:34.863699 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 151/295] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:34 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:35.138235 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-2a0de6e3-d27f-4b0e-bda0-0df8724bcd37 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:35.138938 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-2a0de6e3-d27f-4b0e-bda0-0df8724bcd37 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:35.146690 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2a0de6e3-d27f-4b0e-bda0-0df8724bcd37 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:35.147247 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2a0de6e3-d27f-4b0e-bda0-0df8724bcd37 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:35.147779 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2a0de6e3-d27f-4b0e-bda0-0df8724bcd37 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:35.148582 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2a0de6e3-d27f-4b0e-bda0-0df8724bcd37 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:35.149108 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2a0de6e3-d27f-4b0e-bda0-0df8724bcd37 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:35.149591 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2a0de6e3-d27f-4b0e-bda0-0df8724bcd37 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:35.282211 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-2a0de6e3-d27f-4b0e-bda0-0df8724bcd37 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:35.293555 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-2a0de6e3-d27f-4b0e-bda0-0df8724bcd37 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1313 microversion: 2.1 time: 0.159769 Sep 02 05:24:35.294268 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 145/296] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:35 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:35.894101 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f67601e2-976d-462f-acaa-039e0ee40149 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:35.895265 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f67601e2-976d-462f-acaa-039e0ee40149 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:35.906120 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f67601e2-976d-462f-acaa-039e0ee40149 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:35.907262 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f67601e2-976d-462f-acaa-039e0ee40149 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:35.908040 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f67601e2-976d-462f-acaa-039e0ee40149 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:35.909225 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f67601e2-976d-462f-acaa-039e0ee40149 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:35.910207 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f67601e2-976d-462f-acaa-039e0ee40149 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:35.911265 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f67601e2-976d-462f-acaa-039e0ee40149 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:36.047311 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f67601e2-976d-462f-acaa-039e0ee40149 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:36.055167 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f67601e2-976d-462f-acaa-039e0ee40149 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.168474 Sep 02 05:24:36.055759 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 152/297] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:35 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:36.317034 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-035b0727-8f02-45f9-ad3e-a6bf65c9b956 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:36.318463 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-035b0727-8f02-45f9-ad3e-a6bf65c9b956 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:36.327259 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-035b0727-8f02-45f9-ad3e-a6bf65c9b956 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:36.328428 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-035b0727-8f02-45f9-ad3e-a6bf65c9b956 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:36.328953 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-035b0727-8f02-45f9-ad3e-a6bf65c9b956 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:36.329748 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-035b0727-8f02-45f9-ad3e-a6bf65c9b956 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:36.330387 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-035b0727-8f02-45f9-ad3e-a6bf65c9b956 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:36.331320 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-035b0727-8f02-45f9-ad3e-a6bf65c9b956 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:36.513924 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-035b0727-8f02-45f9-ad3e-a6bf65c9b956 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:36.524973 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-035b0727-8f02-45f9-ad3e-a6bf65c9b956 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1313 microversion: 2.1 time: 0.214195 Sep 02 05:24:36.526254 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 146/298] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:36 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:36.805057 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-9888dfed-9043-4d53-a934-7598149b4a04 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e011f26a-6e74-45d2-bfc1-71d938ef80da"}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:24:36.809517 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-9888dfed-9043-4d53-a934-7598149b4a04 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:36.818833 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9888dfed-9043-4d53-a934-7598149b4a04 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:36.819957 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9888dfed-9043-4d53-a934-7598149b4a04 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:36.820624 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9888dfed-9043-4d53-a934-7598149b4a04 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:36.821533 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9888dfed-9043-4d53-a934-7598149b4a04 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:36.822151 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9888dfed-9043-4d53-a934-7598149b4a04 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:36.823131 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9888dfed-9043-4d53-a934-7598149b4a04 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:36.845886 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-df0e1901-6476-4b68-950a-bbc5bb09d705 req-5fecb486-f22b-4872-8043-abe200f99b50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9200a700-8511-4a70-b23e-57ec47b86af6", "tag": "1e1ff3d3-b1b2-42ff-b3f8-143ad4fed430"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:24:36.866383 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-df0e1901-6476-4b68-950a-bbc5bb09d705 req-5fecb486-f22b-4872-8043-abe200f99b50 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:36.867042 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-df0e1901-6476-4b68-950a-bbc5bb09d705 req-5fecb486-f22b-4872-8043-abe200f99b50 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:36.867663 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-df0e1901-6476-4b68-950a-bbc5bb09d705 req-5fecb486-f22b-4872-8043-abe200f99b50 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:36.887445 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-df0e1901-6476-4b68-950a-bbc5bb09d705 req-5fecb486-f22b-4872-8043-abe200f99b50 service nova] Creating event network-changed:1e1ff3d3-b1b2-42ff-b3f8-143ad4fed430 for instance 9200a700-8511-4a70-b23e-57ec47b86af6 on hv-cinder-85391 Sep 02 05:24:36.906301 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-df0e1901-6476-4b68-950a-bbc5bb09d705 req-5fecb486-f22b-4872-8043-abe200f99b50 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064966 Sep 02 05:24:36.907147 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 147/299] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 05:24:37.079312 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-bb7afd7b-9c93-441b-8b3d-5a99890ebbd6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:37.080986 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-bb7afd7b-9c93-441b-8b3d-5a99890ebbd6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:37.088841 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bb7afd7b-9c93-441b-8b3d-5a99890ebbd6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:37.089524 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bb7afd7b-9c93-441b-8b3d-5a99890ebbd6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:37.089965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bb7afd7b-9c93-441b-8b3d-5a99890ebbd6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:37.091266 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bb7afd7b-9c93-441b-8b3d-5a99890ebbd6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:37.091946 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bb7afd7b-9c93-441b-8b3d-5a99890ebbd6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:37.092742 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bb7afd7b-9c93-441b-8b3d-5a99890ebbd6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:37.265387 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-9888dfed-9043-4d53-a934-7598149b4a04 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "POST /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.464576 Sep 02 05:24:37.266408 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 153/300] 10.222.0.30 () {60 vars in 1323 bytes} [Fri Sep 2 05:24:36 2022] POST /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47/os-volume_attachments => generated 194 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:24:37.267521 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-bb7afd7b-9c93-441b-8b3d-5a99890ebbd6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:37.280102 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-bb7afd7b-9c93-441b-8b3d-5a99890ebbd6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.205630 Sep 02 05:24:37.280733 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 148/301] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:37 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:37.552531 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-fcb57181-a5b7-4c71-93f9-5c4b8aacf559 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:37.553727 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-fcb57181-a5b7-4c71-93f9-5c4b8aacf559 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:37.562778 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fcb57181-a5b7-4c71-93f9-5c4b8aacf559 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:37.563104 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fcb57181-a5b7-4c71-93f9-5c4b8aacf559 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:37.563549 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fcb57181-a5b7-4c71-93f9-5c4b8aacf559 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:37.564574 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fcb57181-a5b7-4c71-93f9-5c4b8aacf559 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:37.565035 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fcb57181-a5b7-4c71-93f9-5c4b8aacf559 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:37.565457 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fcb57181-a5b7-4c71-93f9-5c4b8aacf559 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:37.747106 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-fcb57181-a5b7-4c71-93f9-5c4b8aacf559 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:37.756017 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-fcb57181-a5b7-4c71-93f9-5c4b8aacf559 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1313 microversion: 2.1 time: 0.210654 Sep 02 05:24:37.756617 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 154/302] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:37 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:38.301720 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-58287c3f-dd6f-4a25-a79a-6e2b8c4feb83 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:38.302414 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-58287c3f-dd6f-4a25-a79a-6e2b8c4feb83 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:38.308852 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-58287c3f-dd6f-4a25-a79a-6e2b8c4feb83 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:38.309520 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-58287c3f-dd6f-4a25-a79a-6e2b8c4feb83 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:38.310144 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-58287c3f-dd6f-4a25-a79a-6e2b8c4feb83 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:38.310849 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-58287c3f-dd6f-4a25-a79a-6e2b8c4feb83 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:38.311298 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-58287c3f-dd6f-4a25-a79a-6e2b8c4feb83 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:38.311717 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-58287c3f-dd6f-4a25-a79a-6e2b8c4feb83 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:38.471958 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-58287c3f-dd6f-4a25-a79a-6e2b8c4feb83 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:38.480296 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-58287c3f-dd6f-4a25-a79a-6e2b8c4feb83 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.182311 Sep 02 05:24:38.480868 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 149/303] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:38 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:38.777118 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-586b6d0a-a493-416b-a167-2bd7c13441b1 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:38.780413 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-586b6d0a-a493-416b-a167-2bd7c13441b1 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:38.794961 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-586b6d0a-a493-416b-a167-2bd7c13441b1 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:38.795541 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-586b6d0a-a493-416b-a167-2bd7c13441b1 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:38.796183 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-586b6d0a-a493-416b-a167-2bd7c13441b1 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:38.797034 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-586b6d0a-a493-416b-a167-2bd7c13441b1 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:38.797483 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-586b6d0a-a493-416b-a167-2bd7c13441b1 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:38.797898 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-586b6d0a-a493-416b-a167-2bd7c13441b1 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:39.001807 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-586b6d0a-a493-416b-a167-2bd7c13441b1 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:39.006626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:39.012761 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-586b6d0a-a493-416b-a167-2bd7c13441b1 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1313 microversion: 2.1 time: 0.239620 Sep 02 05:24:39.013787 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 155/304] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:38 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:39.502621 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-730be784-f026-4a4b-85a1-3a4b78ced0a7 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:39.503837 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-730be784-f026-4a4b-85a1-3a4b78ced0a7 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:39.511549 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-730be784-f026-4a4b-85a1-3a4b78ced0a7 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:39.512067 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-730be784-f026-4a4b-85a1-3a4b78ced0a7 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:39.512607 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-730be784-f026-4a4b-85a1-3a4b78ced0a7 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:39.513517 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-730be784-f026-4a4b-85a1-3a4b78ced0a7 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:39.513965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-730be784-f026-4a4b-85a1-3a4b78ced0a7 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:39.514903 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-730be784-f026-4a4b-85a1-3a4b78ced0a7 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:39.703904 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-730be784-f026-4a4b-85a1-3a4b78ced0a7 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:39.714300 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-730be784-f026-4a4b-85a1-3a4b78ced0a7 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.216593 Sep 02 05:24:39.716558 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 150/305] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:39 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:40.035827 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-52e86629-01ea-451e-a6e5-2c5cd159fe07 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:40.036669 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-52e86629-01ea-451e-a6e5-2c5cd159fe07 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:40.044822 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-52e86629-01ea-451e-a6e5-2c5cd159fe07 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:40.045777 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-52e86629-01ea-451e-a6e5-2c5cd159fe07 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:40.046862 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-52e86629-01ea-451e-a6e5-2c5cd159fe07 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:40.047875 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-52e86629-01ea-451e-a6e5-2c5cd159fe07 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:40.048732 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-52e86629-01ea-451e-a6e5-2c5cd159fe07 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:40.049400 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-52e86629-01ea-451e-a6e5-2c5cd159fe07 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:40.344531 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-52e86629-01ea-451e-a6e5-2c5cd159fe07 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:40.360775 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-52e86629-01ea-451e-a6e5-2c5cd159fe07 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1313 microversion: 2.1 time: 0.330116 Sep 02 05:24:40.361737 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 156/306] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:40 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1313 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:40.736301 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-bf4c4a37-8e64-499d-aacb-2dbc83a32c37 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:40.736903 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-bf4c4a37-8e64-499d-aacb-2dbc83a32c37 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:40.747886 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bf4c4a37-8e64-499d-aacb-2dbc83a32c37 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:40.748409 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bf4c4a37-8e64-499d-aacb-2dbc83a32c37 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:40.749010 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bf4c4a37-8e64-499d-aacb-2dbc83a32c37 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:40.749860 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bf4c4a37-8e64-499d-aacb-2dbc83a32c37 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:40.750466 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bf4c4a37-8e64-499d-aacb-2dbc83a32c37 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:40.751032 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bf4c4a37-8e64-499d-aacb-2dbc83a32c37 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:40.977202 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-bf4c4a37-8e64-499d-aacb-2dbc83a32c37 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:40.987035 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-bf4c4a37-8e64-499d-aacb-2dbc83a32c37 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.254389 Sep 02 05:24:40.989130 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 151/307] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:40 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:41.386397 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f164cb32-8b91-430a-a06d-af6322bd0efc tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:41.388670 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f164cb32-8b91-430a-a06d-af6322bd0efc tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:41.404570 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f164cb32-8b91-430a-a06d-af6322bd0efc tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:41.405569 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f164cb32-8b91-430a-a06d-af6322bd0efc tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:41.406180 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f164cb32-8b91-430a-a06d-af6322bd0efc tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:41.407675 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f164cb32-8b91-430a-a06d-af6322bd0efc tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:41.408628 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f164cb32-8b91-430a-a06d-af6322bd0efc tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:41.409254 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f164cb32-8b91-430a-a06d-af6322bd0efc tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:41.921939 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f164cb32-8b91-430a-a06d-af6322bd0efc tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:41.931180 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f164cb32-8b91-430a-a06d-af6322bd0efc tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1313 microversion: 2.1 time: 0.553236 Sep 02 05:24:41.931764 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 157/308] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:41 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1313 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:42.009958 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-46979e7e-e051-4a77-bc3e-9a85ae243bd9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:42.010636 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-46979e7e-e051-4a77-bc3e-9a85ae243bd9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:42.025270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-46979e7e-e051-4a77-bc3e-9a85ae243bd9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:42.027071 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-46979e7e-e051-4a77-bc3e-9a85ae243bd9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:42.029421 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-46979e7e-e051-4a77-bc3e-9a85ae243bd9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:42.030586 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-46979e7e-e051-4a77-bc3e-9a85ae243bd9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:42.032555 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-46979e7e-e051-4a77-bc3e-9a85ae243bd9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:42.033576 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-46979e7e-e051-4a77-bc3e-9a85ae243bd9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:42.437198 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-46979e7e-e051-4a77-bc3e-9a85ae243bd9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:42.446242 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-46979e7e-e051-4a77-bc3e-9a85ae243bd9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.440344 Sep 02 05:24:42.449767 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 152/309] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:42 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:42.951762 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-fa5b8116-aeef-43ae-9410-9d05626712d7 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:42.952580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-fa5b8116-aeef-43ae-9410-9d05626712d7 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:42.960983 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fa5b8116-aeef-43ae-9410-9d05626712d7 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:42.961475 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fa5b8116-aeef-43ae-9410-9d05626712d7 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:42.961913 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fa5b8116-aeef-43ae-9410-9d05626712d7 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:42.962611 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fa5b8116-aeef-43ae-9410-9d05626712d7 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:42.963060 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fa5b8116-aeef-43ae-9410-9d05626712d7 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:42.964545 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fa5b8116-aeef-43ae-9410-9d05626712d7 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:43.265325 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-fa5b8116-aeef-43ae-9410-9d05626712d7 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:43.281019 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-fa5b8116-aeef-43ae-9410-9d05626712d7 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1313 microversion: 2.1 time: 0.333298 Sep 02 05:24:43.297807 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 158/310] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:42 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:43.470577 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-4dbc638d-bbf9-4b52-918e-122ef2738f2c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:43.473532 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-4dbc638d-bbf9-4b52-918e-122ef2738f2c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:43.484244 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4dbc638d-bbf9-4b52-918e-122ef2738f2c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:43.484799 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4dbc638d-bbf9-4b52-918e-122ef2738f2c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:43.486674 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4dbc638d-bbf9-4b52-918e-122ef2738f2c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:43.487412 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4dbc638d-bbf9-4b52-918e-122ef2738f2c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:43.490579 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4dbc638d-bbf9-4b52-918e-122ef2738f2c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:43.491262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4dbc638d-bbf9-4b52-918e-122ef2738f2c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:43.501908 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=100 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:43.895294 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-4dbc638d-bbf9-4b52-918e-122ef2738f2c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:43.910694 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-4dbc638d-bbf9-4b52-918e-122ef2738f2c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.445765 Sep 02 05:24:43.911296 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 153/311] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:43 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:44.307173 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-3dab7618-97f8-4474-871a-ff76b1d64134 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:44.308974 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-3dab7618-97f8-4474-871a-ff76b1d64134 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:44.322737 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3dab7618-97f8-4474-871a-ff76b1d64134 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:44.324179 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3dab7618-97f8-4474-871a-ff76b1d64134 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:44.326555 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3dab7618-97f8-4474-871a-ff76b1d64134 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:44.327658 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3dab7618-97f8-4474-871a-ff76b1d64134 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:44.328619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3dab7618-97f8-4474-871a-ff76b1d64134 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:44.330704 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3dab7618-97f8-4474-871a-ff76b1d64134 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:44.557927 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-bd655f55-f23a-485e-a218-ce552d96c7ac req-2102fc7b-11a8-440e-b9d2-63c0cb051b82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9200a700-8511-4a70-b23e-57ec47b86af6", "name": "network-vif-plugged", "status": "completed", "tag": "1e1ff3d3-b1b2-42ff-b3f8-143ad4fed430"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:24:44.580747 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-bd655f55-f23a-485e-a218-ce552d96c7ac req-2102fc7b-11a8-440e-b9d2-63c0cb051b82 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:44.581426 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-bd655f55-f23a-485e-a218-ce552d96c7ac req-2102fc7b-11a8-440e-b9d2-63c0cb051b82 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:44.585196 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-bd655f55-f23a-485e-a218-ce552d96c7ac req-2102fc7b-11a8-440e-b9d2-63c0cb051b82 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:44.602379 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-3dab7618-97f8-4474-871a-ff76b1d64134 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:44.605370 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-bd655f55-f23a-485e-a218-ce552d96c7ac req-2102fc7b-11a8-440e-b9d2-63c0cb051b82 service nova] Creating event network-vif-plugged:1e1ff3d3-b1b2-42ff-b3f8-143ad4fed430 for instance 9200a700-8511-4a70-b23e-57ec47b86af6 on hv-cinder-85391 Sep 02 05:24:44.612738 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-3dab7618-97f8-4474-871a-ff76b1d64134 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1313 microversion: 2.1 time: 0.309949 Sep 02 05:24:44.613925 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 159/312] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:44 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:44.619335 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-bd655f55-f23a-485e-a218-ce552d96c7ac req-2102fc7b-11a8-440e-b9d2-63c0cb051b82 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065385 Sep 02 05:24:44.620156 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 154/313] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 05:24:44.934437 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-3ea3ba61-fa76-49fe-b26e-d235820d1fa2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:44.935063 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-3ea3ba61-fa76-49fe-b26e-d235820d1fa2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:44.943189 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3ea3ba61-fa76-49fe-b26e-d235820d1fa2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:44.944134 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3ea3ba61-fa76-49fe-b26e-d235820d1fa2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:44.944589 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3ea3ba61-fa76-49fe-b26e-d235820d1fa2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:44.949594 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3ea3ba61-fa76-49fe-b26e-d235820d1fa2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:44.952580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3ea3ba61-fa76-49fe-b26e-d235820d1fa2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:44.953091 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3ea3ba61-fa76-49fe-b26e-d235820d1fa2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:45.142947 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-3ea3ba61-fa76-49fe-b26e-d235820d1fa2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:45.160603 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-3ea3ba61-fa76-49fe-b26e-d235820d1fa2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.232401 Sep 02 05:24:45.163907 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 160/314] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:44 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:45.635458 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-27d94add-1b41-4686-beee-9d373ff9fbea tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:45.636386 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-27d94add-1b41-4686-beee-9d373ff9fbea tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:45.646044 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-27d94add-1b41-4686-beee-9d373ff9fbea tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:45.646620 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-27d94add-1b41-4686-beee-9d373ff9fbea tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:45.647123 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-27d94add-1b41-4686-beee-9d373ff9fbea tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:45.647892 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-27d94add-1b41-4686-beee-9d373ff9fbea tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:45.648475 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-27d94add-1b41-4686-beee-9d373ff9fbea tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:45.648964 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-27d94add-1b41-4686-beee-9d373ff9fbea tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:45.876793 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-27d94add-1b41-4686-beee-9d373ff9fbea tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:45.890831 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-27d94add-1b41-4686-beee-9d373ff9fbea tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1313 microversion: 2.1 time: 0.257219 Sep 02 05:24:45.906750 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 155/315] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:45 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:46.182708 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-86a7838a-12f7-445e-868d-dd15b191f171 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:46.183225 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-86a7838a-12f7-445e-868d-dd15b191f171 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:46.193090 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-86a7838a-12f7-445e-868d-dd15b191f171 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:46.193517 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-86a7838a-12f7-445e-868d-dd15b191f171 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:46.193889 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-86a7838a-12f7-445e-868d-dd15b191f171 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:46.195656 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-86a7838a-12f7-445e-868d-dd15b191f171 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:46.196108 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-86a7838a-12f7-445e-868d-dd15b191f171 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:46.198480 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-86a7838a-12f7-445e-868d-dd15b191f171 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:46.384689 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-86a7838a-12f7-445e-868d-dd15b191f171 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:46.397175 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-86a7838a-12f7-445e-868d-dd15b191f171 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.218818 Sep 02 05:24:46.399208 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 161/316] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:46 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:46.910931 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-d7ba6725-5c0b-4221-b025-e5683bb999d9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:46.911669 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-d7ba6725-5c0b-4221-b025-e5683bb999d9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:46.918872 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d7ba6725-5c0b-4221-b025-e5683bb999d9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:46.921168 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d7ba6725-5c0b-4221-b025-e5683bb999d9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:46.921614 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d7ba6725-5c0b-4221-b025-e5683bb999d9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:46.922325 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d7ba6725-5c0b-4221-b025-e5683bb999d9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:46.922784 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d7ba6725-5c0b-4221-b025-e5683bb999d9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:46.923207 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d7ba6725-5c0b-4221-b025-e5683bb999d9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:47.228372 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-d7ba6725-5c0b-4221-b025-e5683bb999d9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:47.240394 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-d7ba6725-5c0b-4221-b025-e5683bb999d9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1313 microversion: 2.1 time: 0.332320 Sep 02 05:24:47.243406 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 156/317] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:46 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1313 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:47.424143 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-cc79e95e-4078-406d-bce0-cbfb0eca8e58 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:47.425017 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-cc79e95e-4078-406d-bce0-cbfb0eca8e58 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:47.438489 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cc79e95e-4078-406d-bce0-cbfb0eca8e58 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:47.440927 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cc79e95e-4078-406d-bce0-cbfb0eca8e58 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:47.441992 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cc79e95e-4078-406d-bce0-cbfb0eca8e58 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:47.445753 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cc79e95e-4078-406d-bce0-cbfb0eca8e58 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:47.447962 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cc79e95e-4078-406d-bce0-cbfb0eca8e58 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:47.448730 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cc79e95e-4078-406d-bce0-cbfb0eca8e58 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:47.933547 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-cc79e95e-4078-406d-bce0-cbfb0eca8e58 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:47.942335 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-cc79e95e-4078-406d-bce0-cbfb0eca8e58 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.523796 Sep 02 05:24:47.961789 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 162/318] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:47 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:48.269123 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-2ab271d7-6b43-41a6-8d62-6d00afd96989 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:48.270366 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-2ab271d7-6b43-41a6-8d62-6d00afd96989 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:48.277306 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2ab271d7-6b43-41a6-8d62-6d00afd96989 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:48.278033 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2ab271d7-6b43-41a6-8d62-6d00afd96989 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:48.278635 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2ab271d7-6b43-41a6-8d62-6d00afd96989 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:48.279505 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2ab271d7-6b43-41a6-8d62-6d00afd96989 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:48.280292 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2ab271d7-6b43-41a6-8d62-6d00afd96989 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:48.280933 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2ab271d7-6b43-41a6-8d62-6d00afd96989 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:48.600290 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-2ab271d7-6b43-41a6-8d62-6d00afd96989 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:48.612992 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-2ab271d7-6b43-41a6-8d62-6d00afd96989 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1313 microversion: 2.1 time: 0.347557 Sep 02 05:24:48.614389 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 157/319] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:48 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:48.967380 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-654793d4-bac6-426b-ae9f-7a0dd1458a97 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:48.968792 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-654793d4-bac6-426b-ae9f-7a0dd1458a97 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:48.977263 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-654793d4-bac6-426b-ae9f-7a0dd1458a97 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:48.980737 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-654793d4-bac6-426b-ae9f-7a0dd1458a97 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:48.981428 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-654793d4-bac6-426b-ae9f-7a0dd1458a97 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:48.983167 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-654793d4-bac6-426b-ae9f-7a0dd1458a97 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:48.984306 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-654793d4-bac6-426b-ae9f-7a0dd1458a97 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:48.987125 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-654793d4-bac6-426b-ae9f-7a0dd1458a97 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:49.367520 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-654793d4-bac6-426b-ae9f-7a0dd1458a97 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:49.377376 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-654793d4-bac6-426b-ae9f-7a0dd1458a97 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.414222 Sep 02 05:24:49.378396 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 163/320] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:48 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:49.642631 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-79b559c1-01d1-4073-b9b6-308d17d3f755 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:49.644883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-79b559c1-01d1-4073-b9b6-308d17d3f755 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:49.655908 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-79b559c1-01d1-4073-b9b6-308d17d3f755 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:49.660429 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-79b559c1-01d1-4073-b9b6-308d17d3f755 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:49.661177 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-79b559c1-01d1-4073-b9b6-308d17d3f755 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:49.674640 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-79b559c1-01d1-4073-b9b6-308d17d3f755 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:49.675449 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-79b559c1-01d1-4073-b9b6-308d17d3f755 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:49.675892 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-79b559c1-01d1-4073-b9b6-308d17d3f755 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:50.026909 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-79b559c1-01d1-4073-b9b6-308d17d3f755 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:50.035978 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-79b559c1-01d1-4073-b9b6-308d17d3f755 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1497 microversion: 2.1 time: 0.398892 Sep 02 05:24:50.036590 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 158/321] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:49 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1497 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:50.398320 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-8e65a39a-332d-450d-b8e8-6695020e590c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:50.398945 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-8e65a39a-332d-450d-b8e8-6695020e590c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:50.402084 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=72 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:50.414731 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8e65a39a-332d-450d-b8e8-6695020e590c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:50.415579 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8e65a39a-332d-450d-b8e8-6695020e590c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:50.417641 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8e65a39a-332d-450d-b8e8-6695020e590c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:50.418581 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8e65a39a-332d-450d-b8e8-6695020e590c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:50.419603 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8e65a39a-332d-450d-b8e8-6695020e590c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:50.420682 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8e65a39a-332d-450d-b8e8-6695020e590c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:50.647451 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-8e65a39a-332d-450d-b8e8-6695020e590c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:50.657086 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-8e65a39a-332d-450d-b8e8-6695020e590c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.261650 Sep 02 05:24:50.672326 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 164/322] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:50 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:50.913272 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-1159bc60-7703-4111-b75b-3d13f5c96838 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:50.915542 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-1159bc60-7703-4111-b75b-3d13f5c96838 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:50.924646 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1159bc60-7703-4111-b75b-3d13f5c96838 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:50.925394 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1159bc60-7703-4111-b75b-3d13f5c96838 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:50.926133 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1159bc60-7703-4111-b75b-3d13f5c96838 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:50.927159 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1159bc60-7703-4111-b75b-3d13f5c96838 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:50.927821 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1159bc60-7703-4111-b75b-3d13f5c96838 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:50.928503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1159bc60-7703-4111-b75b-3d13f5c96838 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:50.975724 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-1159bc60-7703-4111-b75b-3d13f5c96838 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Going to try to terminate instance {{(pid=120449) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 05:24:51.196773 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-1159bc60-7703-4111-b75b-3d13f5c96838 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 204 len: 0 microversion: 2.1 time: 0.288378 Sep 02 05:24:51.198072 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 159/323] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Sep 2 05:24:50 2022] DELETE /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 05:24:51.206425 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-ca1594f3-0eb0-4389-82e0-3e778c7b004e tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:51.207051 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-ca1594f3-0eb0-4389-82e0-3e778c7b004e tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:51.218949 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ca1594f3-0eb0-4389-82e0-3e778c7b004e tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:51.219402 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ca1594f3-0eb0-4389-82e0-3e778c7b004e tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:51.219880 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ca1594f3-0eb0-4389-82e0-3e778c7b004e tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:51.220604 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ca1594f3-0eb0-4389-82e0-3e778c7b004e tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:51.225729 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ca1594f3-0eb0-4389-82e0-3e778c7b004e tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:51.226358 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ca1594f3-0eb0-4389-82e0-3e778c7b004e tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:51.359329 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-fa9cbfbd-c5b5-41b9-8c40-ee87e0f4093a tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:51.360240 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-fa9cbfbd-c5b5-41b9-8c40-ee87e0f4093a tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:51.367541 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fa9cbfbd-c5b5-41b9-8c40-ee87e0f4093a tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:51.368658 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fa9cbfbd-c5b5-41b9-8c40-ee87e0f4093a tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:51.369315 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fa9cbfbd-c5b5-41b9-8c40-ee87e0f4093a tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:51.370867 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fa9cbfbd-c5b5-41b9-8c40-ee87e0f4093a tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:51.371884 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fa9cbfbd-c5b5-41b9-8c40-ee87e0f4093a tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:51.372630 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fa9cbfbd-c5b5-41b9-8c40-ee87e0f4093a tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:51.410049 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-fa9cbfbd-c5b5-41b9-8c40-ee87e0f4093a tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Going to try to terminate instance {{(pid=120449) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 05:24:51.438141 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-ca1594f3-0eb0-4389-82e0-3e778c7b004e tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:51.447793 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-ca1594f3-0eb0-4389-82e0-3e778c7b004e tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1554 microversion: 2.1 time: 0.245628 Sep 02 05:24:51.448733 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 165/324] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:51 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1554 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:51.541230 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-fa9cbfbd-c5b5-41b9-8c40-ee87e0f4093a tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 204 len: 0 microversion: 2.1 time: 0.185652 Sep 02 05:24:51.541958 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 160/325] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Sep 2 05:24:51 2022] DELETE /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 05:24:51.550811 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-8c3907ed-c7ea-4840-9706-f13755cb23eb tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:51.551868 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-8c3907ed-c7ea-4840-9706-f13755cb23eb tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:51.564683 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8c3907ed-c7ea-4840-9706-f13755cb23eb tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:51.565481 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8c3907ed-c7ea-4840-9706-f13755cb23eb tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:51.566677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8c3907ed-c7ea-4840-9706-f13755cb23eb tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:51.568079 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8c3907ed-c7ea-4840-9706-f13755cb23eb tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:51.569255 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8c3907ed-c7ea-4840-9706-f13755cb23eb tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:51.570031 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8c3907ed-c7ea-4840-9706-f13755cb23eb tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:51.678927 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-a8f6d786-0633-407a-9ed3-ecf8441895da tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:51.679832 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-a8f6d786-0633-407a-9ed3-ecf8441895da tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:51.697967 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a8f6d786-0633-407a-9ed3-ecf8441895da tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:51.701124 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a8f6d786-0633-407a-9ed3-ecf8441895da tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:51.701911 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a8f6d786-0633-407a-9ed3-ecf8441895da tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:51.702889 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a8f6d786-0633-407a-9ed3-ecf8441895da tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:51.704531 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a8f6d786-0633-407a-9ed3-ecf8441895da tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:51.709436 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a8f6d786-0633-407a-9ed3-ecf8441895da tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:51.964320 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-8c3907ed-c7ea-4840-9706-f13755cb23eb tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:51.975456 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-8c3907ed-c7ea-4840-9706-f13755cb23eb tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1503 microversion: 2.1 time: 0.429005 Sep 02 05:24:51.982771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 166/326] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:51 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1503 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:24:51.995460 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-a8f6d786-0633-407a-9ed3-ecf8441895da tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:52.007283 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-a8f6d786-0633-407a-9ed3-ecf8441895da tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.332664 Sep 02 05:24:52.007944 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 161/327] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:51 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:24:52.397182 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-ff8eef27-e953-44a1-b7de-2a421f14328a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Action: 'create', calling method: .version_select at 0x7fc90b6a7040>, body: {"keypair": {"name": "tempest-TestShelveInstance-1688213221", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEELl45yv9pRBwMoKRP/B08Nwm3JbQUGdcO+ps1S6OZL7bGQR4r2R3/jwFWZKfoBICT5v5zkuMGBz7ofLPR3zZjfMrEfSLdVQ3zqZwDpKlk5Iv62rM+6hkDqZLemVOXKUQ=="}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:24:52.413434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-ff8eef27-e953-44a1-b7de-2a421f14328a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Getting quotas for project 7edadaa7db8145ab9ddb2d2ed4a3a5df. Resources: {'key_pairs'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:24:52.417438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-ff8eef27-e953-44a1-b7de-2a421f14328a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Getting quotas for user 268723dc1de74a53b6379fae0626e02b and project 7edadaa7db8145ab9ddb2d2ed4a3a5df. Resources: {'key_pairs'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:24:52.442287 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-ff8eef27-e953-44a1-b7de-2a421f14328a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.257108 Sep 02 05:24:52.448754 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 167/328] 10.222.0.30 () {60 vars in 1159 bytes} [Fri Sep 2 05:24:52 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:24:52.469645 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-3462de1c-9aec-45b3-85d3-e4a3d981d748 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:52.470601 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-3462de1c-9aec-45b3-85d3-e4a3d981d748 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:52.477728 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3462de1c-9aec-45b3-85d3-e4a3d981d748 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:52.478485 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3462de1c-9aec-45b3-85d3-e4a3d981d748 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:52.479031 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3462de1c-9aec-45b3-85d3-e4a3d981d748 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:52.479904 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3462de1c-9aec-45b3-85d3-e4a3d981d748 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:52.480421 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3462de1c-9aec-45b3-85d3-e4a3d981d748 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:52.480838 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3462de1c-9aec-45b3-85d3-e4a3d981d748 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:52.696662 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-3462de1c-9aec-45b3-85d3-e4a3d981d748 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:52.708828 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-3462de1c-9aec-45b3-85d3-e4a3d981d748 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1554 microversion: 2.1 time: 0.240497 Sep 02 05:24:52.709945 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 162/329] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:52 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1554 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:52.999341 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-b34935bd-db11-4179-a11c-9567cb0189e6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:52.999949 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-b34935bd-db11-4179-a11c-9567cb0189e6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:53.008183 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b34935bd-db11-4179-a11c-9567cb0189e6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:53.008668 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b34935bd-db11-4179-a11c-9567cb0189e6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:53.009095 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b34935bd-db11-4179-a11c-9567cb0189e6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:53.009776 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b34935bd-db11-4179-a11c-9567cb0189e6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:53.010250 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b34935bd-db11-4179-a11c-9567cb0189e6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:53.010665 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b34935bd-db11-4179-a11c-9567cb0189e6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:53.028260 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-90558f34-ab56-4532-a492-862407161195 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:53.029019 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-90558f34-ab56-4532-a492-862407161195 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:53.036192 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-90558f34-ab56-4532-a492-862407161195 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:53.037019 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-90558f34-ab56-4532-a492-862407161195 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:53.037689 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-90558f34-ab56-4532-a492-862407161195 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:53.038833 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-90558f34-ab56-4532-a492-862407161195 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:53.039562 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-90558f34-ab56-4532-a492-862407161195 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:53.040306 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-90558f34-ab56-4532-a492-862407161195 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:53.243297 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-b34935bd-db11-4179-a11c-9567cb0189e6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:53.249368 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-90558f34-ab56-4532-a492-862407161195 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:53.252673 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-b34935bd-db11-4179-a11c-9567cb0189e6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1503 microversion: 2.1 time: 0.257025 Sep 02 05:24:53.253971 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 168/330] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:52 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1503 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:53.257632 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-90558f34-ab56-4532-a492-862407161195 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.233542 Sep 02 05:24:53.258192 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 163/331] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:53 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:24:53.729643 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-00cc5605-7e82-4cc8-a30e-f31a53c24f05 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:53.730407 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-00cc5605-7e82-4cc8-a30e-f31a53c24f05 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:53.739203 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-00cc5605-7e82-4cc8-a30e-f31a53c24f05 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:53.739839 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-00cc5605-7e82-4cc8-a30e-f31a53c24f05 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:53.740699 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-00cc5605-7e82-4cc8-a30e-f31a53c24f05 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:53.741590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-00cc5605-7e82-4cc8-a30e-f31a53c24f05 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:53.742214 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-00cc5605-7e82-4cc8-a30e-f31a53c24f05 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:53.742637 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-00cc5605-7e82-4cc8-a30e-f31a53c24f05 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:53.925386 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-00cc5605-7e82-4cc8-a30e-f31a53c24f05 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:53.935583 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-00cc5605-7e82-4cc8-a30e-f31a53c24f05 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1554 microversion: 2.1 time: 0.209713 Sep 02 05:24:53.936647 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 169/332] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:53 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1554 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:54.277882 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-9658a390-da33-414b-a9e1-7dac6e0b5e8d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:54.280400 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-07225f9e-2458-4a5d-92b7-5fb6f5494668 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:54.281015 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-07225f9e-2458-4a5d-92b7-5fb6f5494668 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:54.282861 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-9658a390-da33-414b-a9e1-7dac6e0b5e8d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:54.291105 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-07225f9e-2458-4a5d-92b7-5fb6f5494668 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:54.293860 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-07225f9e-2458-4a5d-92b7-5fb6f5494668 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:54.295636 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9658a390-da33-414b-a9e1-7dac6e0b5e8d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:54.296662 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-07225f9e-2458-4a5d-92b7-5fb6f5494668 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:54.297615 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9658a390-da33-414b-a9e1-7dac6e0b5e8d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:54.297615 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9658a390-da33-414b-a9e1-7dac6e0b5e8d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:54.298645 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-07225f9e-2458-4a5d-92b7-5fb6f5494668 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:54.299518 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9658a390-da33-414b-a9e1-7dac6e0b5e8d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:54.300185 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-07225f9e-2458-4a5d-92b7-5fb6f5494668 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:54.300836 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9658a390-da33-414b-a9e1-7dac6e0b5e8d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:54.301606 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-07225f9e-2458-4a5d-92b7-5fb6f5494668 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:54.303865 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9658a390-da33-414b-a9e1-7dac6e0b5e8d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:54.603625 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-9658a390-da33-414b-a9e1-7dac6e0b5e8d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:54.613807 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-9658a390-da33-414b-a9e1-7dac6e0b5e8d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.339906 Sep 02 05:24:54.624423 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 170/333] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:54 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:24:54.633839 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-07225f9e-2458-4a5d-92b7-5fb6f5494668 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:54.643779 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-07225f9e-2458-4a5d-92b7-5fb6f5494668 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1503 microversion: 2.1 time: 0.373706 Sep 02 05:24:54.645885 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 164/334] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:54 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1503 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:54.958002 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-4aee1f0c-5ea0-4a62-8ec1-3d1640f2e1db tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:54.958658 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-4aee1f0c-5ea0-4a62-8ec1-3d1640f2e1db tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:54.965131 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4aee1f0c-5ea0-4a62-8ec1-3d1640f2e1db tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:54.965695 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4aee1f0c-5ea0-4a62-8ec1-3d1640f2e1db tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:54.966201 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4aee1f0c-5ea0-4a62-8ec1-3d1640f2e1db tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:54.966935 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4aee1f0c-5ea0-4a62-8ec1-3d1640f2e1db tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:54.967385 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4aee1f0c-5ea0-4a62-8ec1-3d1640f2e1db tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:54.967986 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4aee1f0c-5ea0-4a62-8ec1-3d1640f2e1db tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:55.114760 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-4aee1f0c-5ea0-4a62-8ec1-3d1640f2e1db tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:55.124937 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-4aee1f0c-5ea0-4a62-8ec1-3d1640f2e1db tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1554 microversion: 2.1 time: 0.171585 Sep 02 05:24:55.125505 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 171/335] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:54 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:55.636346 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-08ff6125-5f13-4ac9-ac75-3dbe3e65a194 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:55.638078 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-08ff6125-5f13-4ac9-ac75-3dbe3e65a194 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:55.640701 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:55.673295 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-355e1ec1-13a1-4bd0-a8c4-00b3fe45ed6f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:55.674457 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-355e1ec1-13a1-4bd0-a8c4-00b3fe45ed6f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:55.682445 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-08ff6125-5f13-4ac9-ac75-3dbe3e65a194 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:55.685379 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-355e1ec1-13a1-4bd0-a8c4-00b3fe45ed6f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:55.686783 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-08ff6125-5f13-4ac9-ac75-3dbe3e65a194 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:55.687430 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-08ff6125-5f13-4ac9-ac75-3dbe3e65a194 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:55.688635 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-355e1ec1-13a1-4bd0-a8c4-00b3fe45ed6f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:55.689316 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-08ff6125-5f13-4ac9-ac75-3dbe3e65a194 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:55.689927 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-08ff6125-5f13-4ac9-ac75-3dbe3e65a194 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:55.690713 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-355e1ec1-13a1-4bd0-a8c4-00b3fe45ed6f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:55.700823 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-08ff6125-5f13-4ac9-ac75-3dbe3e65a194 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:55.703872 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-355e1ec1-13a1-4bd0-a8c4-00b3fe45ed6f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:55.704387 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-355e1ec1-13a1-4bd0-a8c4-00b3fe45ed6f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:55.708292 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-355e1ec1-13a1-4bd0-a8c4-00b3fe45ed6f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:56.089693 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-08ff6125-5f13-4ac9-ac75-3dbe3e65a194 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:56.100769 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-08ff6125-5f13-4ac9-ac75-3dbe3e65a194 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.468687 Sep 02 05:24:56.117349 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 165/336] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:55 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:56.147976 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-1a422067-0e65-4a26-9560-438aa2f80ecd tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:56.148697 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-1a422067-0e65-4a26-9560-438aa2f80ecd tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:56.161262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1a422067-0e65-4a26-9560-438aa2f80ecd tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:56.161937 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1a422067-0e65-4a26-9560-438aa2f80ecd tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:56.162655 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1a422067-0e65-4a26-9560-438aa2f80ecd tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:56.163359 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1a422067-0e65-4a26-9560-438aa2f80ecd tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:56.163810 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1a422067-0e65-4a26-9560-438aa2f80ecd tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:56.164252 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1a422067-0e65-4a26-9560-438aa2f80ecd tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:56.283336 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-355e1ec1-13a1-4bd0-a8c4-00b3fe45ed6f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:56.302086 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-355e1ec1-13a1-4bd0-a8c4-00b3fe45ed6f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1503 microversion: 2.1 time: 0.637258 Sep 02 05:24:56.306844 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 172/337] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:55 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1503 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:56.458247 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1a422067-0e65-4a26-9560-438aa2f80ecd tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:56.470734 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-1a422067-0e65-4a26-9560-438aa2f80ecd tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1554 microversion: 2.1 time: 0.328005 Sep 02 05:24:56.471312 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 166/338] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:56 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1554 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:24:56.675275 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-62f70d96-e8fe-4fee-8b93-467a3a804519 req-ce18dfc1-bc63-419f-90af-28bc3c18b420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9200a700-8511-4a70-b23e-57ec47b86af6", "name": "network-vif-deleted", "tag": "1e1ff3d3-b1b2-42ff-b3f8-143ad4fed430"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:24:56.692912 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-62f70d96-e8fe-4fee-8b93-467a3a804519 req-ce18dfc1-bc63-419f-90af-28bc3c18b420 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:56.693424 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-62f70d96-e8fe-4fee-8b93-467a3a804519 req-ce18dfc1-bc63-419f-90af-28bc3c18b420 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:56.694174 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-62f70d96-e8fe-4fee-8b93-467a3a804519 req-ce18dfc1-bc63-419f-90af-28bc3c18b420 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:56.721820 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-62f70d96-e8fe-4fee-8b93-467a3a804519 req-ce18dfc1-bc63-419f-90af-28bc3c18b420 service nova] Creating event network-vif-deleted:1e1ff3d3-b1b2-42ff-b3f8-143ad4fed430 for instance 9200a700-8511-4a70-b23e-57ec47b86af6 on hv-cinder-85391 Sep 02 05:24:56.741806 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-62f70d96-e8fe-4fee-8b93-467a3a804519 req-ce18dfc1-bc63-419f-90af-28bc3c18b420 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069864 Sep 02 05:24:56.743328 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 173/339] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:24:57.121847 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-62a989a9-703c-4a9c-8c57-21d11c38b6e9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:57.122475 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-62a989a9-703c-4a9c-8c57-21d11c38b6e9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:57.129264 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-62a989a9-703c-4a9c-8c57-21d11c38b6e9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:57.130236 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-62a989a9-703c-4a9c-8c57-21d11c38b6e9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:57.130690 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-62a989a9-703c-4a9c-8c57-21d11c38b6e9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:57.131448 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-62a989a9-703c-4a9c-8c57-21d11c38b6e9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:57.131967 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-62a989a9-703c-4a9c-8c57-21d11c38b6e9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:57.132865 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-62a989a9-703c-4a9c-8c57-21d11c38b6e9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:57.137169 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:57.328673 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-a69815e2-ad8e-472a-b83e-f1f0991ad0d3 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:57.330151 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-a69815e2-ad8e-472a-b83e-f1f0991ad0d3 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:57.346975 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a69815e2-ad8e-472a-b83e-f1f0991ad0d3 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:57.350984 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a69815e2-ad8e-472a-b83e-f1f0991ad0d3 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:57.351460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a69815e2-ad8e-472a-b83e-f1f0991ad0d3 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:57.352265 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a69815e2-ad8e-472a-b83e-f1f0991ad0d3 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:57.352937 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a69815e2-ad8e-472a-b83e-f1f0991ad0d3 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:57.353393 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a69815e2-ad8e-472a-b83e-f1f0991ad0d3 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:57.358884 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-62a989a9-703c-4a9c-8c57-21d11c38b6e9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:57.366793 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-62a989a9-703c-4a9c-8c57-21d11c38b6e9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.249453 Sep 02 05:24:57.367345 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 167/340] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:57 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:57.382269 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=100 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:57.423122 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a69815e2-ad8e-472a-b83e-f1f0991ad0d3 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:57.423785 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a69815e2-ad8e-472a-b83e-f1f0991ad0d3 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:57.424254 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a69815e2-ad8e-472a-b83e-f1f0991ad0d3 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:57.424942 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.objects.instance [None req-a69815e2-ad8e-472a-b83e-f1f0991ad0d3 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lazy-loading 'fault' on Instance uuid 9200a700-8511-4a70-b23e-57ec47b86af6 {{(pid=120448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:24:57.496816 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-4037bd09-622c-4f34-9c1f-8cf6a3641981 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:57.497595 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-4037bd09-622c-4f34-9c1f-8cf6a3641981 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:57.504958 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4037bd09-622c-4f34-9c1f-8cf6a3641981 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:57.506031 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4037bd09-622c-4f34-9c1f-8cf6a3641981 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:57.506766 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4037bd09-622c-4f34-9c1f-8cf6a3641981 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:57.507876 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4037bd09-622c-4f34-9c1f-8cf6a3641981 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:57.508584 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4037bd09-622c-4f34-9c1f-8cf6a3641981 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:57.509238 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4037bd09-622c-4f34-9c1f-8cf6a3641981 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:57.536174 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-a69815e2-ad8e-472a-b83e-f1f0991ad0d3 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:57.549742 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-a69815e2-ad8e-472a-b83e-f1f0991ad0d3 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 200 len: 1303 microversion: 2.1 time: 0.223894 Sep 02 05:24:57.550921 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 174/341] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:57 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 1303 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:57.553603 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4037bd09-622c-4f34-9c1f-8cf6a3641981 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:57.554103 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4037bd09-622c-4f34-9c1f-8cf6a3641981 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:57.554523 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4037bd09-622c-4f34-9c1f-8cf6a3641981 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:57.554967 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.objects.instance [None req-4037bd09-622c-4f34-9c1f-8cf6a3641981 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lazy-loading 'fault' on Instance uuid 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 {{(pid=120449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:24:57.609892 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-4037bd09-622c-4f34-9c1f-8cf6a3641981 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e72a813c51e499883779df76996a7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ad0d3adab048ae90a0c7f64d75b61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:57.619638 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-4037bd09-622c-4f34-9c1f-8cf6a3641981 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 200 len: 1350 microversion: 2.1 time: 0.127462 Sep 02 05:24:57.620235 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 168/342] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:57 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 1350 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:58.388675 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-abacf630-0253-4dbc-98e8-eb9b54579e7a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:58.390236 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-abacf630-0253-4dbc-98e8-eb9b54579e7a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:58.397139 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-abacf630-0253-4dbc-98e8-eb9b54579e7a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:58.397852 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-abacf630-0253-4dbc-98e8-eb9b54579e7a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:58.398499 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-abacf630-0253-4dbc-98e8-eb9b54579e7a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:58.399667 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-abacf630-0253-4dbc-98e8-eb9b54579e7a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:58.400174 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-abacf630-0253-4dbc-98e8-eb9b54579e7a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:58.401069 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-abacf630-0253-4dbc-98e8-eb9b54579e7a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:58.571318 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-a837c8a0-fee0-4821-883a-da0fe2bb04c6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:58.573125 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-a837c8a0-fee0-4821-883a-da0fe2bb04c6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: 9200a700-8511-4a70-b23e-57ec47b86af6] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:58.581394 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a837c8a0-fee0-4821-883a-da0fe2bb04c6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:58.582809 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a837c8a0-fee0-4821-883a-da0fe2bb04c6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:58.587549 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a837c8a0-fee0-4821-883a-da0fe2bb04c6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:58.588390 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a837c8a0-fee0-4821-883a-da0fe2bb04c6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:58.588871 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a837c8a0-fee0-4821-883a-da0fe2bb04c6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:58.589296 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a837c8a0-fee0-4821-883a-da0fe2bb04c6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:58.615711 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-abacf630-0253-4dbc-98e8-eb9b54579e7a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:58.616601 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.wsgi [None req-a837c8a0-fee0-4821-883a-da0fe2bb04c6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] HTTP exception thrown: Instance 9200a700-8511-4a70-b23e-57ec47b86af6 could not be found. Sep 02 05:24:58.623257 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-a837c8a0-fee0-4821-883a-da0fe2bb04c6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Request method failure captured: Sep 02 05:24:58.623257 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: request: GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 HTTP/1.1 Sep 02 05:24:58.623257 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept: application/json Sep 02 05:24:58.623257 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept-Encoding: identity Sep 02 05:24:58.623257 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Connection: close Sep 02 05:24:58.623257 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Length: 0 Sep 02 05:24:58.623257 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Type: application/json Sep 02 05:24:58.623257 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Host: 10.222.0.30 Sep 02 05:24:58.623257 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Openstack-System-Scope: None Sep 02 05:24:58.623257 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: User-Agent: python-urllib3/1.26.12 Sep 02 05:24:58.623257 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Auth-Token: gAAAAABjEZNsgTFaVPNC9qEsb35x5XiTMWuigEaHYSQiDQ7JgB5n6dsdK3LNPJS5_LdYdpVLn1qR3LKwIxqJbADer2UBsuk7O7N0Q92KOlo7pYjgLZpxncQbW9zlTJivp0blflE1ruG7H0gVeoAcWnhedwnC_wyGrAosdHRNgV52mY3Sce3oVZE Sep 02 05:24:58.623257 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Id: None Sep 02 05:24:58.623257 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Name: None Sep 02 05:24:58.623257 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Identity-Status: Confirmed Sep 02 05:24:58.623257 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Is-Admin-Project: True Sep 02 05:24:58.623257 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Id: default Sep 02 05:24:58.623257 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Name: Default Sep 02 05:24:58.623257 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Id: 179a293b863c45bfa9642ec75a94b824 Sep 02 05:24:58.623257 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Name: tempest-VolumesActionsTest-891452206 Sep 02 05:24:58.623257 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Role: member,reader Sep 02 05:24:58.623257 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Roles: member,reader Sep 02 05:24:58.624751 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_179a293b863c45bfa9642ec75a94b824"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/179a293b863c45bfa9642ec75a94b824"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/179a293b863c45bfa9642ec75a94b824"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/179a293b863c45bfa9642ec75a94b824"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:24:58.624751 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant: tempest-VolumesActionsTest-891452206 Sep 02 05:24:58.624751 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Id: 179a293b863c45bfa9642ec75a94b824 Sep 02 05:24:58.624751 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Name: tempest-VolumesActionsTest-891452206 Sep 02 05:24:58.624751 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User: tempest-VolumesActionsTest-891452206-project Sep 02 05:24:58.624751 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Id: default Sep 02 05:24:58.624751 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Name: Default Sep 02 05:24:58.624751 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Id: a007e2f923f142f8a82e8a976a8e660f Sep 02 05:24:58.624751 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Name: tempest-VolumesActionsTest-891452206-project Sep 02 05:24:58.624751 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: method: > Sep 02 05:24:58.624751 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: exception: Instance 9200a700-8511-4a70-b23e-57ec47b86af6 could not be found. Sep 02 05:24:58.624751 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: action_args: {'id': '9200a700-8511-4a70-b23e-57ec47b86af6'} Sep 02 05:24:58.625506 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:24:58.625506 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:24:58.625506 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:24:58.625506 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:24:58.625506 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:24:58.625506 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:24:58.625506 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:24:58.625506 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:24:58.625506 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:24:58.625506 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:24:58.625506 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9200a700-8511-4a70-b23e-57ec47b86af6 could not be found. Sep 02 05:24:58.625506 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:24:58.625506 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:24:58.625506 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:24:58.625506 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:24:58.625506 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:24:58.625506 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:24:58.625506 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:24:58.625506 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:24:58.625506 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:24:58.626627 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:24:58.626627 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:24:58.626627 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:24:58.626627 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:24:58.626627 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:24:58.626627 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:24:58.626627 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:24:58.626627 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9200a700-8511-4a70-b23e-57ec47b86af6 could not be found. Sep 02 05:24:58.626627 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:24:58.626627 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:24:58.626627 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:24:58.626627 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:24:58.626627 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:24:58.626627 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:24:58.626627 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:24:58.626627 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:24:58.626627 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9200a700-8511-4a70-b23e-57ec47b86af6 could not be found. Sep 02 05:24:58.626627 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:24:58.627626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-abacf630-0253-4dbc-98e8-eb9b54579e7a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.240512 Sep 02 05:24:58.627626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 175/343] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:58 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:58.629176 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-a837c8a0-fee0-4821-883a-da0fe2bb04c6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Returning 404 to user: Instance 9200a700-8511-4a70-b23e-57ec47b86af6 could not be found. {{(pid=120449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:24:58.630269 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-a837c8a0-fee0-4821-883a-da0fe2bb04c6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6" status: 404 len: 111 microversion: 2.1 time: 0.063187 Sep 02 05:24:58.631309 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 169/344] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:58 2022] GET /compute/v2.1/servers/9200a700-8511-4a70-b23e-57ec47b86af6 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:24:58.653104 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-5c8a6181-49f6-40ee-b32d-7c93beab69d9 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:58.653872 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-5c8a6181-49f6-40ee-b32d-7c93beab69d9 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:58.662594 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5c8a6181-49f6-40ee-b32d-7c93beab69d9 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:58.663598 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5c8a6181-49f6-40ee-b32d-7c93beab69d9 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:58.663863 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5c8a6181-49f6-40ee-b32d-7c93beab69d9 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:58.664585 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5c8a6181-49f6-40ee-b32d-7c93beab69d9 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:58.665243 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5c8a6181-49f6-40ee-b32d-7c93beab69d9 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:58.665651 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5c8a6181-49f6-40ee-b32d-7c93beab69d9 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:58.680916 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.wsgi [None req-5c8a6181-49f6-40ee-b32d-7c93beab69d9 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] HTTP exception thrown: Instance 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 could not be found. Sep 02 05:24:58.685509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-5c8a6181-49f6-40ee-b32d-7c93beab69d9 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Request method failure captured: Sep 02 05:24:58.685509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: request: GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 HTTP/1.1 Sep 02 05:24:58.685509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept: application/json Sep 02 05:24:58.685509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept-Encoding: identity Sep 02 05:24:58.685509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Connection: close Sep 02 05:24:58.685509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Length: 0 Sep 02 05:24:58.685509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Type: application/json Sep 02 05:24:58.685509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Host: 10.222.0.30 Sep 02 05:24:58.685509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Openstack-System-Scope: None Sep 02 05:24:58.685509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: User-Agent: python-urllib3/1.26.12 Sep 02 05:24:58.685509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Auth-Token: gAAAAABjEZNG9ARm9AwdAETjZUbEDa87Q2_1-fLPwxQCjXWqV-ThU8CWfg6BwxCsp71arN-B3i4yPljJyZw_VbxmInmCpaPxmK3natx7iGE5aY7DzQ0aGczr1r-agGhYBwAVuJYBYv_mqF4IIgRwgLxdzDttFPDcT-uYtIMVWM8LcqzeVbgGdxw Sep 02 05:24:58.685509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Id: None Sep 02 05:24:58.685509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Name: None Sep 02 05:24:58.685509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Identity-Status: Confirmed Sep 02 05:24:58.685509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Is-Admin-Project: True Sep 02 05:24:58.685509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Id: default Sep 02 05:24:58.685509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Name: Default Sep 02 05:24:58.685509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Id: 60ad0d3adab048ae90a0c7f64d75b61d Sep 02 05:24:58.685509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Name: tempest-DeleteServersTestJSON-1308364281 Sep 02 05:24:58.685509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Role: member,reader Sep 02 05:24:58.685509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Roles: member,reader Sep 02 05:24:58.686883 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_60ad0d3adab048ae90a0c7f64d75b61d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/60ad0d3adab048ae90a0c7f64d75b61d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/60ad0d3adab048ae90a0c7f64d75b61d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/60ad0d3adab048ae90a0c7f64d75b61d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:24:58.686883 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant: tempest-DeleteServersTestJSON-1308364281 Sep 02 05:24:58.686883 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Id: 60ad0d3adab048ae90a0c7f64d75b61d Sep 02 05:24:58.686883 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Name: tempest-DeleteServersTestJSON-1308364281 Sep 02 05:24:58.686883 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User: tempest-DeleteServersTestJSON-1308364281-project Sep 02 05:24:58.686883 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Id: default Sep 02 05:24:58.686883 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Name: Default Sep 02 05:24:58.686883 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Id: 6e72a813c51e499883779df76996a7b1 Sep 02 05:24:58.686883 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Name: tempest-DeleteServersTestJSON-1308364281-project Sep 02 05:24:58.686883 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: method: > Sep 02 05:24:58.686883 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: exception: Instance 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 could not be found. Sep 02 05:24:58.686883 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: action_args: {'id': '8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47'} Sep 02 05:24:58.687560 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:24:58.687560 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:24:58.687560 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:24:58.687560 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:24:58.687560 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:24:58.687560 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:24:58.687560 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:24:58.687560 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:24:58.687560 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:24:58.687560 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:24:58.687560 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 could not be found. Sep 02 05:24:58.687560 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:24:58.687560 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:24:58.687560 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:24:58.687560 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:24:58.687560 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:24:58.687560 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:24:58.687560 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:24:58.687560 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:24:58.687560 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:24:58.688677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:24:58.688677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:24:58.688677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:24:58.688677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:24:58.688677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:24:58.688677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:24:58.688677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:24:58.688677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 could not be found. Sep 02 05:24:58.688677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:24:58.688677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:24:58.688677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:24:58.688677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:24:58.688677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:24:58.688677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:24:58.688677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:24:58.688677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:24:58.688677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 could not be found. Sep 02 05:24:58.688677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:24:58.690627 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-5c8a6181-49f6-40ee-b32d-7c93beab69d9 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Returning 404 to user: Instance 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 could not be found. {{(pid=120448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:24:58.690627 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-5c8a6181-49f6-40ee-b32d-7c93beab69d9 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 404 len: 111 microversion: 2.1 time: 0.041279 Sep 02 05:24:58.690913 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 176/345] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:58 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:24:58.761287 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-c89333cf-b276-44ef-be09-0a1a86f1efbe req-dc231568-ad4e-44a8-8ae3-9d75c2b3aaed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47", "name": "network-vif-deleted", "tag": "a32283d3-a932-4202-9e94-3dce7c235497"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:24:58.771883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-c89333cf-b276-44ef-be09-0a1a86f1efbe req-dc231568-ad4e-44a8-8ae3-9d75c2b3aaed service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:58.772389 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-c89333cf-b276-44ef-be09-0a1a86f1efbe req-dc231568-ad4e-44a8-8ae3-9d75c2b3aaed service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:58.772812 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-c89333cf-b276-44ef-be09-0a1a86f1efbe req-dc231568-ad4e-44a8-8ae3-9d75c2b3aaed service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:58.784067 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-c89333cf-b276-44ef-be09-0a1a86f1efbe req-dc231568-ad4e-44a8-8ae3-9d75c2b3aaed service nova] Creating event network-vif-deleted:a32283d3-a932-4202-9e94-3dce7c235497 for instance 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 on hv-cinder-85391 Sep 02 05:24:58.807201 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-e39409a3-6fe9-4db9-9ace-8585ee938642 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2083961490", "imageRef": "f3669111-2e3f-4f39-878f-19d263505eaa", "flavorRef": "452", "networks": [{"uuid": "6129eeca-b362-47ba-b416-329cd7e4324d"}]}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:24:58.807778 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-c89333cf-b276-44ef-be09-0a1a86f1efbe req-dc231568-ad4e-44a8-8ae3-9d75c2b3aaed service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050272 Sep 02 05:24:58.808403 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 170/346] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:24:58.831891 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-170abf7b-27bd-4a5c-ace3-8128811b0bc3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:58.837294 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-170abf7b-27bd-4a5c-ace3-8128811b0bc3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:58.845207 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-170abf7b-27bd-4a5c-ace3-8128811b0bc3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:58.846148 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-170abf7b-27bd-4a5c-ace3-8128811b0bc3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:58.846676 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-170abf7b-27bd-4a5c-ace3-8128811b0bc3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:58.847508 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-170abf7b-27bd-4a5c-ace3-8128811b0bc3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:58.848070 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-170abf7b-27bd-4a5c-ace3-8128811b0bc3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:58.848553 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-170abf7b-27bd-4a5c-ace3-8128811b0bc3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:58.886077 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.wsgi [None req-170abf7b-27bd-4a5c-ace3-8128811b0bc3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] HTTP exception thrown: Instance 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 could not be found. Sep 02 05:24:58.888650 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.network.neutron [None req-e39409a3-6fe9-4db9-9ace-8585ee938642 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] validate_networks() for [('6129eeca-b362-47ba-b416-329cd7e4324d', None, None, None, None, None)] {{(pid=120448) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 05:24:58.889687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-170abf7b-27bd-4a5c-ace3-8128811b0bc3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Request method failure captured: Sep 02 05:24:58.889687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: request: GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47/os-volume_attachments HTTP/1.1 Sep 02 05:24:58.889687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept: application/json Sep 02 05:24:58.889687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept-Encoding: identity Sep 02 05:24:58.889687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Connection: close Sep 02 05:24:58.889687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Length: 0 Sep 02 05:24:58.889687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Type: application/json Sep 02 05:24:58.889687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Host: 10.222.0.30 Sep 02 05:24:58.889687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Openstack-System-Scope: None Sep 02 05:24:58.889687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: User-Agent: python-urllib3/1.26.12 Sep 02 05:24:58.889687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Auth-Token: gAAAAABjEZNG9ARm9AwdAETjZUbEDa87Q2_1-fLPwxQCjXWqV-ThU8CWfg6BwxCsp71arN-B3i4yPljJyZw_VbxmInmCpaPxmK3natx7iGE5aY7DzQ0aGczr1r-agGhYBwAVuJYBYv_mqF4IIgRwgLxdzDttFPDcT-uYtIMVWM8LcqzeVbgGdxw Sep 02 05:24:58.889687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Id: None Sep 02 05:24:58.889687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Name: None Sep 02 05:24:58.889687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Identity-Status: Confirmed Sep 02 05:24:58.889687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Is-Admin-Project: True Sep 02 05:24:58.889687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Id: default Sep 02 05:24:58.889687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Name: Default Sep 02 05:24:58.889687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Id: 60ad0d3adab048ae90a0c7f64d75b61d Sep 02 05:24:58.889687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Name: tempest-DeleteServersTestJSON-1308364281 Sep 02 05:24:58.889687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Role: member,reader Sep 02 05:24:58.889687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Roles: member,reader Sep 02 05:24:58.891239 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_60ad0d3adab048ae90a0c7f64d75b61d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/60ad0d3adab048ae90a0c7f64d75b61d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/60ad0d3adab048ae90a0c7f64d75b61d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/60ad0d3adab048ae90a0c7f64d75b61d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:24:58.891239 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant: tempest-DeleteServersTestJSON-1308364281 Sep 02 05:24:58.891239 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Id: 60ad0d3adab048ae90a0c7f64d75b61d Sep 02 05:24:58.891239 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Name: tempest-DeleteServersTestJSON-1308364281 Sep 02 05:24:58.891239 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User: tempest-DeleteServersTestJSON-1308364281-project Sep 02 05:24:58.891239 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Id: default Sep 02 05:24:58.891239 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Name: Default Sep 02 05:24:58.891239 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Id: 6e72a813c51e499883779df76996a7b1 Sep 02 05:24:58.891239 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Name: tempest-DeleteServersTestJSON-1308364281-project Sep 02 05:24:58.891239 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: method: > Sep 02 05:24:58.891239 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: exception: Instance 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 could not be found. Sep 02 05:24:58.891239 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: action_args: {'server_id': '8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47'} Sep 02 05:24:58.891955 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:24:58.891955 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:24:58.891955 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:24:58.891955 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:24:58.891955 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:24:58.891955 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:24:58.891955 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:24:58.891955 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:24:58.891955 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:24:58.891955 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:24:58.891955 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 could not be found. Sep 02 05:24:58.891955 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:24:58.891955 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:24:58.891955 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:24:58.891955 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:24:58.891955 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:24:58.891955 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:24:58.891955 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:24:58.891955 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:24:58.891955 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:24:58.893139 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:24:58.893139 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 02 05:24:58.893139 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 05:24:58.893139 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 02 05:24:58.893139 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 05:24:58.893139 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 02 05:24:58.893139 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 02 05:24:58.893139 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:24:58.893139 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:24:58.893139 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 could not be found. Sep 02 05:24:58.893139 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:24:58.893139 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:24:58.893139 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:24:58.893139 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:24:58.893139 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:24:58.893139 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:24:58.893139 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:24:58.893139 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:24:58.893139 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 could not be found. Sep 02 05:24:58.893139 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:24:58.894194 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-170abf7b-27bd-4a5c-ace3-8128811b0bc3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Returning 404 to user: Instance 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 could not be found. {{(pid=120449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:24:58.900366 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-170abf7b-27bd-4a5c-ace3-8128811b0bc3 tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.071497 Sep 02 05:24:58.901468 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 171/347] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Sep 2 05:24:58 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47/os-volume_attachments => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 05:24:59.376905 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-e39409a3-6fe9-4db9-9ace-8585ee938642 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Flavor limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 05:24:59.377318 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-e39409a3-6fe9-4db9-9ace-8585ee938642 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Image limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 05:24:59.377779 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-e39409a3-6fe9-4db9-9ace-8585ee938642 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Flavor pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 05:24:59.379442 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-e39409a3-6fe9-4db9-9ace-8585ee938642 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Image pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 05:24:59.379867 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-e39409a3-6fe9-4db9-9ace-8585ee938642 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 05:24:59.390665 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e39409a3-6fe9-4db9-9ace-8585ee938642 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:59.392079 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e39409a3-6fe9-4db9-9ace-8585ee938642 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:59.392698 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e39409a3-6fe9-4db9-9ace-8585ee938642 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:59.393599 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e39409a3-6fe9-4db9-9ace-8585ee938642 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:59.394227 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e39409a3-6fe9-4db9-9ace-8585ee938642 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:59.394901 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e39409a3-6fe9-4db9-9ace-8585ee938642 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:59.416632 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-e39409a3-6fe9-4db9-9ace-8585ee938642 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Getting quotas for project 179a293b863c45bfa9642ec75a94b824. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:24:59.420941 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-e39409a3-6fe9-4db9-9ace-8585ee938642 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Getting quotas for user a007e2f923f142f8a82e8a976a8e660f and project 179a293b863c45bfa9642ec75a94b824. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:24:59.436568 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-e39409a3-6fe9-4db9-9ace-8585ee938642 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Going to run 1 instances... {{(pid=120448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 05:24:59.438923 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-e39409a3-6fe9-4db9-9ace-8585ee938642 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3669111-2e3f-4f39-878f-19d263505eaa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 05:24:59.493733 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-e39409a3-6fe9-4db9-9ace-8585ee938642 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690510 Sep 02 05:24:59.494707 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 177/348] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Sep 2 05:24:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 02 05:24:59.505655 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-6a8d1795-e90a-4832-87b7-524790ef73f6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:59.506257 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-6a8d1795-e90a-4832-87b7-524790ef73f6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:59.563095 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-6a8d1795-e90a-4832-87b7-524790ef73f6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:59.571687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-6a8d1795-e90a-4832-87b7-524790ef73f6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 200 len: 1214 microversion: 2.1 time: 0.069775 Sep 02 05:24:59.574280 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 172/349] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:59 2022] GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:24:59.648601 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-41560a0c-b95f-4aa7-ad8e-bc66fe6a1948 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:24:59.649289 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-41560a0c-b95f-4aa7-ad8e-bc66fe6a1948 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:24:59.656764 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-41560a0c-b95f-4aa7-ad8e-bc66fe6a1948 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:59.657570 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-41560a0c-b95f-4aa7-ad8e-bc66fe6a1948 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:59.658005 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-41560a0c-b95f-4aa7-ad8e-bc66fe6a1948 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:59.658707 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-41560a0c-b95f-4aa7-ad8e-bc66fe6a1948 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:24:59.659465 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-41560a0c-b95f-4aa7-ad8e-bc66fe6a1948 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:24:59.660086 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-41560a0c-b95f-4aa7-ad8e-bc66fe6a1948 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:24:59.843115 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-41560a0c-b95f-4aa7-ad8e-bc66fe6a1948 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:24:59.857992 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-41560a0c-b95f-4aa7-ad8e-bc66fe6a1948 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.213684 Sep 02 05:24:59.859001 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 178/350] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:24:59 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:00.159773 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-e76430c8-bb32-4a03-a072-ffbf3fa69f6d tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:00.160471 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-e76430c8-bb32-4a03-a072-ffbf3fa69f6d tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:00.167683 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e76430c8-bb32-4a03-a072-ffbf3fa69f6d tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:00.168600 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e76430c8-bb32-4a03-a072-ffbf3fa69f6d tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:00.169007 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e76430c8-bb32-4a03-a072-ffbf3fa69f6d tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:00.169785 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e76430c8-bb32-4a03-a072-ffbf3fa69f6d tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:00.171754 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e76430c8-bb32-4a03-a072-ffbf3fa69f6d tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:00.172251 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e76430c8-bb32-4a03-a072-ffbf3fa69f6d tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:00.186853 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.wsgi [None req-e76430c8-bb32-4a03-a072-ffbf3fa69f6d tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] HTTP exception thrown: Instance 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 could not be found. Sep 02 05:25:00.188615 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-e76430c8-bb32-4a03-a072-ffbf3fa69f6d tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Request method failure captured: Sep 02 05:25:00.188615 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: request: DELETE /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 HTTP/1.1 Sep 02 05:25:00.188615 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept: application/json Sep 02 05:25:00.188615 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept-Encoding: identity Sep 02 05:25:00.188615 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Connection: close Sep 02 05:25:00.188615 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Length: 0 Sep 02 05:25:00.188615 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Type: application/json Sep 02 05:25:00.188615 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Host: 10.222.0.30 Sep 02 05:25:00.188615 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Openstack-System-Scope: None Sep 02 05:25:00.188615 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: User-Agent: python-urllib3/1.26.12 Sep 02 05:25:00.188615 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Auth-Token: gAAAAABjEZNG9ARm9AwdAETjZUbEDa87Q2_1-fLPwxQCjXWqV-ThU8CWfg6BwxCsp71arN-B3i4yPljJyZw_VbxmInmCpaPxmK3natx7iGE5aY7DzQ0aGczr1r-agGhYBwAVuJYBYv_mqF4IIgRwgLxdzDttFPDcT-uYtIMVWM8LcqzeVbgGdxw Sep 02 05:25:00.188615 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Id: None Sep 02 05:25:00.188615 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Name: None Sep 02 05:25:00.188615 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Identity-Status: Confirmed Sep 02 05:25:00.188615 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Is-Admin-Project: True Sep 02 05:25:00.188615 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Id: default Sep 02 05:25:00.188615 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Name: Default Sep 02 05:25:00.188615 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Id: 60ad0d3adab048ae90a0c7f64d75b61d Sep 02 05:25:00.188615 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Name: tempest-DeleteServersTestJSON-1308364281 Sep 02 05:25:00.188615 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Role: member,reader Sep 02 05:25:00.188615 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Roles: member,reader Sep 02 05:25:00.189801 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_60ad0d3adab048ae90a0c7f64d75b61d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/60ad0d3adab048ae90a0c7f64d75b61d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/60ad0d3adab048ae90a0c7f64d75b61d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/60ad0d3adab048ae90a0c7f64d75b61d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:25:00.189801 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant: tempest-DeleteServersTestJSON-1308364281 Sep 02 05:25:00.189801 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Id: 60ad0d3adab048ae90a0c7f64d75b61d Sep 02 05:25:00.189801 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Name: tempest-DeleteServersTestJSON-1308364281 Sep 02 05:25:00.189801 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User: tempest-DeleteServersTestJSON-1308364281-project Sep 02 05:25:00.189801 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Id: default Sep 02 05:25:00.189801 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Name: Default Sep 02 05:25:00.189801 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Id: 6e72a813c51e499883779df76996a7b1 Sep 02 05:25:00.189801 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Name: tempest-DeleteServersTestJSON-1308364281-project Sep 02 05:25:00.189801 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: method: > Sep 02 05:25:00.189801 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: exception: Instance 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 could not be found. Sep 02 05:25:00.189801 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: action_args: {'id': '8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47'} Sep 02 05:25:00.190540 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:25:00.190540 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:25:00.190540 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:25:00.190540 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:25:00.190540 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:25:00.190540 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:25:00.190540 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:25:00.190540 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:25:00.190540 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:25:00.190540 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:25:00.190540 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 could not be found. Sep 02 05:25:00.190540 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:25:00.190540 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:25:00.190540 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:25:00.190540 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:25:00.190540 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:25:00.190540 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:25:00.190540 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:25:00.190540 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:25:00.190540 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:25:00.191638 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:25:00.191638 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 05:25:00.191638 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 05:25:00.191638 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 05:25:00.191638 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 05:25:00.191638 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:25:00.191638 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:25:00.191638 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:25:00.191638 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:25:00.191638 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 could not be found. Sep 02 05:25:00.191638 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:25:00.191638 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:25:00.191638 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:25:00.191638 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:25:00.191638 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:25:00.191638 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:25:00.191638 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:25:00.191638 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:25:00.191638 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 could not be found. Sep 02 05:25:00.191638 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:25:00.192772 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-e76430c8-bb32-4a03-a072-ffbf3fa69f6d tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Returning 404 to user: Instance 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 could not be found. {{(pid=120449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:25:00.192772 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-e76430c8-bb32-4a03-a072-ffbf3fa69f6d tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 404 len: 111 microversion: 2.1 time: 0.034295 Sep 02 05:25:00.192772 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 173/351] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Sep 2 05:25:00 2022] DELETE /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:25:00.199707 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-a3fec18e-d059-40e0-8d47-883c6566d83b tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:00.200917 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-a3fec18e-d059-40e0-8d47-883c6566d83b tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] [instance: 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:00.207569 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a3fec18e-d059-40e0-8d47-883c6566d83b tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:00.208278 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a3fec18e-d059-40e0-8d47-883c6566d83b tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:00.208712 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a3fec18e-d059-40e0-8d47-883c6566d83b tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:00.209408 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a3fec18e-d059-40e0-8d47-883c6566d83b tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:00.209862 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a3fec18e-d059-40e0-8d47-883c6566d83b tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:00.210283 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a3fec18e-d059-40e0-8d47-883c6566d83b tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:00.223705 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.wsgi [None req-a3fec18e-d059-40e0-8d47-883c6566d83b tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] HTTP exception thrown: Instance 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 could not be found. Sep 02 05:25:00.225253 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-a3fec18e-d059-40e0-8d47-883c6566d83b tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Request method failure captured: Sep 02 05:25:00.225253 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: request: GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 HTTP/1.1 Sep 02 05:25:00.225253 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept: application/json Sep 02 05:25:00.225253 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept-Encoding: identity Sep 02 05:25:00.225253 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Connection: close Sep 02 05:25:00.225253 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Length: 0 Sep 02 05:25:00.225253 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Type: application/json Sep 02 05:25:00.225253 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Host: 10.222.0.30 Sep 02 05:25:00.225253 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Openstack-System-Scope: None Sep 02 05:25:00.225253 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: User-Agent: python-urllib3/1.26.12 Sep 02 05:25:00.225253 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Auth-Token: gAAAAABjEZNG9ARm9AwdAETjZUbEDa87Q2_1-fLPwxQCjXWqV-ThU8CWfg6BwxCsp71arN-B3i4yPljJyZw_VbxmInmCpaPxmK3natx7iGE5aY7DzQ0aGczr1r-agGhYBwAVuJYBYv_mqF4IIgRwgLxdzDttFPDcT-uYtIMVWM8LcqzeVbgGdxw Sep 02 05:25:00.225253 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Id: None Sep 02 05:25:00.225253 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Name: None Sep 02 05:25:00.225253 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Identity-Status: Confirmed Sep 02 05:25:00.225253 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Is-Admin-Project: True Sep 02 05:25:00.225253 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Id: default Sep 02 05:25:00.225253 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Name: Default Sep 02 05:25:00.225253 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Id: 60ad0d3adab048ae90a0c7f64d75b61d Sep 02 05:25:00.225253 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Name: tempest-DeleteServersTestJSON-1308364281 Sep 02 05:25:00.225253 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Role: member,reader Sep 02 05:25:00.225253 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Roles: member,reader Sep 02 05:25:00.226702 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_60ad0d3adab048ae90a0c7f64d75b61d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/60ad0d3adab048ae90a0c7f64d75b61d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/60ad0d3adab048ae90a0c7f64d75b61d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/60ad0d3adab048ae90a0c7f64d75b61d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:25:00.226702 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant: tempest-DeleteServersTestJSON-1308364281 Sep 02 05:25:00.226702 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Id: 60ad0d3adab048ae90a0c7f64d75b61d Sep 02 05:25:00.226702 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Name: tempest-DeleteServersTestJSON-1308364281 Sep 02 05:25:00.226702 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User: tempest-DeleteServersTestJSON-1308364281-project Sep 02 05:25:00.226702 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Id: default Sep 02 05:25:00.226702 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Name: Default Sep 02 05:25:00.226702 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Id: 6e72a813c51e499883779df76996a7b1 Sep 02 05:25:00.226702 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Name: tempest-DeleteServersTestJSON-1308364281-project Sep 02 05:25:00.226702 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: method: > Sep 02 05:25:00.226702 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: exception: Instance 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 could not be found. Sep 02 05:25:00.226702 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: action_args: {'id': '8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47'} Sep 02 05:25:00.227438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:25:00.227438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:25:00.227438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:25:00.227438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:25:00.227438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:25:00.227438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:25:00.227438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:25:00.227438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:25:00.227438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:25:00.227438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:25:00.227438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 could not be found. Sep 02 05:25:00.227438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:25:00.227438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:25:00.227438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:25:00.227438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:25:00.227438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:25:00.227438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:25:00.227438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:25:00.227438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:25:00.227438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:25:00.229715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:25:00.229715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:25:00.229715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:25:00.229715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:25:00.229715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:25:00.229715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:25:00.229715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:25:00.229715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 could not be found. Sep 02 05:25:00.229715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:25:00.229715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:25:00.229715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:25:00.229715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:25:00.229715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:25:00.229715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:25:00.229715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:25:00.229715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:25:00.229715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 could not be found. Sep 02 05:25:00.229715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:25:00.230969 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-a3fec18e-d059-40e0-8d47-883c6566d83b tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] Returning 404 to user: Instance 8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 could not be found. {{(pid=120448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:25:00.230969 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-a3fec18e-d059-40e0-8d47-883c6566d83b tempest-DeleteServersTestJSON-1308364281 tempest-DeleteServersTestJSON-1308364281-project] 10.222.0.30 "GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47" status: 404 len: 111 microversion: 2.1 time: 0.031488 Sep 02 05:25:00.230969 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 179/352] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:00 2022] GET /compute/v2.1/servers/8f52d9a1-d0bd-4ede-b0ab-c2f4efa12b47 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:25:00.594243 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-cef251a1-4fba-4189-a4a9-fc39dd1726fe tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:00.594900 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-cef251a1-4fba-4189-a4a9-fc39dd1726fe tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:00.604442 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cef251a1-4fba-4189-a4a9-fc39dd1726fe tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:00.604937 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cef251a1-4fba-4189-a4a9-fc39dd1726fe tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:00.605370 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cef251a1-4fba-4189-a4a9-fc39dd1726fe tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:00.606072 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cef251a1-4fba-4189-a4a9-fc39dd1726fe tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:00.606523 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cef251a1-4fba-4189-a4a9-fc39dd1726fe tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:00.607175 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cef251a1-4fba-4189-a4a9-fc39dd1726fe tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:00.687465 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-cef251a1-4fba-4189-a4a9-fc39dd1726fe tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:00.703297 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-cef251a1-4fba-4189-a4a9-fc39dd1726fe tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 200 len: 1266 microversion: 2.1 time: 0.114134 Sep 02 05:25:00.704348 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 174/353] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:00 2022] GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 1266 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:00.878980 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-1d78c1f6-ad41-4600-89f0-cdb427c270f4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:00.879600 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-1d78c1f6-ad41-4600-89f0-cdb427c270f4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:00.886038 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1d78c1f6-ad41-4600-89f0-cdb427c270f4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:00.886507 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1d78c1f6-ad41-4600-89f0-cdb427c270f4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:00.887147 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1d78c1f6-ad41-4600-89f0-cdb427c270f4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:00.887829 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1d78c1f6-ad41-4600-89f0-cdb427c270f4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:00.888309 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1d78c1f6-ad41-4600-89f0-cdb427c270f4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:00.888731 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1d78c1f6-ad41-4600-89f0-cdb427c270f4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:01.160180 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-1d78c1f6-ad41-4600-89f0-cdb427c270f4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:01.172921 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-1d78c1f6-ad41-4600-89f0-cdb427c270f4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.297664 Sep 02 05:25:01.173844 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 180/354] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:00 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:01.729888 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-d61b957e-c62a-49fc-b8e7-658bfc6c7ef9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:01.732004 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-d61b957e-c62a-49fc-b8e7-658bfc6c7ef9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:01.741984 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d61b957e-c62a-49fc-b8e7-658bfc6c7ef9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:01.742743 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d61b957e-c62a-49fc-b8e7-658bfc6c7ef9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:01.744167 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d61b957e-c62a-49fc-b8e7-658bfc6c7ef9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:01.745439 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d61b957e-c62a-49fc-b8e7-658bfc6c7ef9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:01.746258 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d61b957e-c62a-49fc-b8e7-658bfc6c7ef9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:01.747029 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d61b957e-c62a-49fc-b8e7-658bfc6c7ef9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:01.845370 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-d61b957e-c62a-49fc-b8e7-658bfc6c7ef9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:01.857354 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-d61b957e-c62a-49fc-b8e7-658bfc6c7ef9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 200 len: 1272 microversion: 2.1 time: 0.135542 Sep 02 05:25:01.859110 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 175/355] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:01 2022] GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 1272 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:25:02.200695 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-bfc7971b-02d2-481b-b086-761cde5525b7 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:02.201238 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-bfc7971b-02d2-481b-b086-761cde5525b7 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:02.208534 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-bfc7971b-02d2-481b-b086-761cde5525b7 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:02.209053 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-bfc7971b-02d2-481b-b086-761cde5525b7 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:02.209583 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-bfc7971b-02d2-481b-b086-761cde5525b7 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:02.210391 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-bfc7971b-02d2-481b-b086-761cde5525b7 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:02.211258 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-bfc7971b-02d2-481b-b086-761cde5525b7 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:02.211258 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-bfc7971b-02d2-481b-b086-761cde5525b7 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:02.347980 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-bfc7971b-02d2-481b-b086-761cde5525b7 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:02.356336 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-bfc7971b-02d2-481b-b086-761cde5525b7 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.160879 Sep 02 05:25:02.356896 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 181/356] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:02 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:25:02.879263 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-1a5a7794-e2b9-4b3b-9c38-23cfca5def82 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:02.880668 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-1a5a7794-e2b9-4b3b-9c38-23cfca5def82 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:02.887858 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1a5a7794-e2b9-4b3b-9c38-23cfca5def82 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:02.888689 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1a5a7794-e2b9-4b3b-9c38-23cfca5def82 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:02.889302 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1a5a7794-e2b9-4b3b-9c38-23cfca5def82 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:02.890255 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1a5a7794-e2b9-4b3b-9c38-23cfca5def82 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:02.891805 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1a5a7794-e2b9-4b3b-9c38-23cfca5def82 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:02.892431 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1a5a7794-e2b9-4b3b-9c38-23cfca5def82 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:03.050977 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1a5a7794-e2b9-4b3b-9c38-23cfca5def82 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:03.060471 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-1a5a7794-e2b9-4b3b-9c38-23cfca5def82 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 200 len: 1314 microversion: 2.1 time: 0.185482 Sep 02 05:25:03.061684 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 176/357] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:02 2022] GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:03.063116 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-31f4fb6c-2848-42ed-a793-c826903b9f51 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-82891800", "imageRef": "f3669111-2e3f-4f39-878f-19d263505eaa", "flavorRef": "452", "networks": [{"uuid": "25225075-5c9c-4031-8f93-0a61f603882b"}]}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:25:03.135072 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.network.neutron [None req-31f4fb6c-2848-42ed-a793-c826903b9f51 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] validate_networks() for [('25225075-5c9c-4031-8f93-0a61f603882b', None, None, None, None, None)] {{(pid=120448) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 05:25:03.377677 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-2f9f8442-2e63-4a47-bd07-bad36f1031e8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:03.378339 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-2f9f8442-2e63-4a47-bd07-bad36f1031e8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:03.384538 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2f9f8442-2e63-4a47-bd07-bad36f1031e8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:03.385214 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2f9f8442-2e63-4a47-bd07-bad36f1031e8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:03.385458 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2f9f8442-2e63-4a47-bd07-bad36f1031e8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:03.386191 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2f9f8442-2e63-4a47-bd07-bad36f1031e8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:03.386627 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2f9f8442-2e63-4a47-bd07-bad36f1031e8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:03.387366 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2f9f8442-2e63-4a47-bd07-bad36f1031e8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:03.917980 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-2f9f8442-2e63-4a47-bd07-bad36f1031e8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:03.928930 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-2f9f8442-2e63-4a47-bd07-bad36f1031e8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.555227 Sep 02 05:25:03.931574 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-31f4fb6c-2848-42ed-a793-c826903b9f51 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Flavor limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 05:25:03.932495 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 177/358] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:03 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:25:03.932776 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-31f4fb6c-2848-42ed-a793-c826903b9f51 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Image limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 05:25:03.933384 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-31f4fb6c-2848-42ed-a793-c826903b9f51 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Flavor pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 05:25:03.933920 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-31f4fb6c-2848-42ed-a793-c826903b9f51 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Image pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 05:25:03.934470 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-31f4fb6c-2848-42ed-a793-c826903b9f51 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 05:25:03.946775 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-31f4fb6c-2848-42ed-a793-c826903b9f51 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:03.947531 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-31f4fb6c-2848-42ed-a793-c826903b9f51 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:03.947954 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-31f4fb6c-2848-42ed-a793-c826903b9f51 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:03.949001 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-31f4fb6c-2848-42ed-a793-c826903b9f51 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:03.949450 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-31f4fb6c-2848-42ed-a793-c826903b9f51 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:03.949865 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-31f4fb6c-2848-42ed-a793-c826903b9f51 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:03.969414 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-31f4fb6c-2848-42ed-a793-c826903b9f51 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Getting quotas for project a0bc748ee5804c9499d0c0b80e14d711. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:25:03.973567 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-31f4fb6c-2848-42ed-a793-c826903b9f51 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Getting quotas for user c5943ce507ca4e67928bc1b98c9e8edb and project a0bc748ee5804c9499d0c0b80e14d711. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:25:03.985547 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-31f4fb6c-2848-42ed-a793-c826903b9f51 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Going to run 1 instances... {{(pid=120448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 05:25:03.987956 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-31f4fb6c-2848-42ed-a793-c826903b9f51 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3669111-2e3f-4f39-878f-19d263505eaa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 05:25:04.041589 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-31f4fb6c-2848-42ed-a793-c826903b9f51 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.982419 Sep 02 05:25:04.042375 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 182/359] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Sep 2 05:25:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 05:25:04.054111 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-66c29abe-c230-4754-b4eb-f94dc9baf75f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:04.055789 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-66c29abe-c230-4754-b4eb-f94dc9baf75f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:04.083584 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-fc03380b-9b97-4dc6-b632-03f340ab2f22 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:04.083716 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-fc03380b-9b97-4dc6-b632-03f340ab2f22 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:04.091167 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fc03380b-9b97-4dc6-b632-03f340ab2f22 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:04.091698 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fc03380b-9b97-4dc6-b632-03f340ab2f22 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:04.092618 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fc03380b-9b97-4dc6-b632-03f340ab2f22 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:04.093519 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fc03380b-9b97-4dc6-b632-03f340ab2f22 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:04.094283 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fc03380b-9b97-4dc6-b632-03f340ab2f22 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:04.095421 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fc03380b-9b97-4dc6-b632-03f340ab2f22 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:04.175323 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-66c29abe-c230-4754-b4eb-f94dc9baf75f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:04.214913 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-66c29abe-c230-4754-b4eb-f94dc9baf75f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b" status: 200 len: 1217 microversion: 2.1 time: 0.165689 Sep 02 05:25:04.217497 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 178/360] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:04 2022] GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b => generated 1217 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:25:04.404069 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-fc03380b-9b97-4dc6-b632-03f340ab2f22 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:04.422613 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-fc03380b-9b97-4dc6-b632-03f340ab2f22 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 200 len: 1314 microversion: 2.1 time: 0.343100 Sep 02 05:25:04.423880 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 183/361] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:04 2022] GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:04.950558 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-3caf4613-9a26-4d71-8894-be184207110b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:04.951161 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-3caf4613-9a26-4d71-8894-be184207110b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:04.971961 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3caf4613-9a26-4d71-8894-be184207110b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:04.972856 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3caf4613-9a26-4d71-8894-be184207110b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:04.978707 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3caf4613-9a26-4d71-8894-be184207110b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:04.982351 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3caf4613-9a26-4d71-8894-be184207110b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:04.983577 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3caf4613-9a26-4d71-8894-be184207110b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:04.984220 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3caf4613-9a26-4d71-8894-be184207110b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:05.240448 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-fccd8cd7-97fb-42f6-90c6-0e59dda5ada5 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:05.241233 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-fccd8cd7-97fb-42f6-90c6-0e59dda5ada5 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:05.247905 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-3caf4613-9a26-4d71-8894-be184207110b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:05.259810 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fccd8cd7-97fb-42f6-90c6-0e59dda5ada5 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:05.260291 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-3caf4613-9a26-4d71-8894-be184207110b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1522 microversion: 2.1 time: 0.313577 Sep 02 05:25:05.261437 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 179/362] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:04 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:05.262638 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fccd8cd7-97fb-42f6-90c6-0e59dda5ada5 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:05.263195 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fccd8cd7-97fb-42f6-90c6-0e59dda5ada5 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:05.264718 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fccd8cd7-97fb-42f6-90c6-0e59dda5ada5 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:05.271724 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fccd8cd7-97fb-42f6-90c6-0e59dda5ada5 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:05.272843 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fccd8cd7-97fb-42f6-90c6-0e59dda5ada5 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:05.356188 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-fccd8cd7-97fb-42f6-90c6-0e59dda5ada5 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:05.363756 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-fccd8cd7-97fb-42f6-90c6-0e59dda5ada5 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b" status: 200 len: 1221 microversion: 2.1 time: 0.128971 Sep 02 05:25:05.364638 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 184/363] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:05 2022] GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b => generated 1221 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:05.444583 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-d3ff61df-a8cc-4aba-8df2-953e9656638a tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:05.445660 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-d3ff61df-a8cc-4aba-8df2-953e9656638a tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:05.455628 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d3ff61df-a8cc-4aba-8df2-953e9656638a tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:05.460607 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d3ff61df-a8cc-4aba-8df2-953e9656638a tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:05.461112 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d3ff61df-a8cc-4aba-8df2-953e9656638a tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:05.461857 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d3ff61df-a8cc-4aba-8df2-953e9656638a tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:05.462786 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d3ff61df-a8cc-4aba-8df2-953e9656638a tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:05.463704 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d3ff61df-a8cc-4aba-8df2-953e9656638a tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:05.670123 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-d3ff61df-a8cc-4aba-8df2-953e9656638a tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:05.680365 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-d3ff61df-a8cc-4aba-8df2-953e9656638a tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 200 len: 1314 microversion: 2.1 time: 0.239949 Sep 02 05:25:05.683534 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 180/364] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:05 2022] GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:05.885709 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-8315fec5-a1e5-4143-8d1e-0921c812b2c6 req-0c3f1f06-0145-44de-be92-d17d3e21b69a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de", "tag": "c2607880-31ef-4eba-b1cd-89f6200c26a5"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:25:05.906227 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-8315fec5-a1e5-4143-8d1e-0921c812b2c6 req-0c3f1f06-0145-44de-be92-d17d3e21b69a service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:05.907098 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-8315fec5-a1e5-4143-8d1e-0921c812b2c6 req-0c3f1f06-0145-44de-be92-d17d3e21b69a service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:05.907671 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-8315fec5-a1e5-4143-8d1e-0921c812b2c6 req-0c3f1f06-0145-44de-be92-d17d3e21b69a service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:05.920646 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-8315fec5-a1e5-4143-8d1e-0921c812b2c6 req-0c3f1f06-0145-44de-be92-d17d3e21b69a service nova] Creating event network-changed:c2607880-31ef-4eba-b1cd-89f6200c26a5 for instance ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de on hv-cinder-85391 Sep 02 05:25:05.926764 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-8315fec5-a1e5-4143-8d1e-0921c812b2c6 req-0c3f1f06-0145-44de-be92-d17d3e21b69a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045288 Sep 02 05:25:05.927988 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 185/365] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:25:06.293837 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5d02d471-3200-4024-8b08-52849884d47a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:06.298939 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5d02d471-3200-4024-8b08-52849884d47a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:06.348941 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5d02d471-3200-4024-8b08-52849884d47a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:06.349888 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5d02d471-3200-4024-8b08-52849884d47a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:06.350691 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5d02d471-3200-4024-8b08-52849884d47a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:06.353268 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5d02d471-3200-4024-8b08-52849884d47a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:06.354488 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5d02d471-3200-4024-8b08-52849884d47a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:06.355505 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5d02d471-3200-4024-8b08-52849884d47a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:06.405090 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-571b3361-2f84-43fe-bb45-561f4890c8ad tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:06.416106 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-571b3361-2f84-43fe-bb45-561f4890c8ad tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:06.444688 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-571b3361-2f84-43fe-bb45-561f4890c8ad tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:06.445544 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-571b3361-2f84-43fe-bb45-561f4890c8ad tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:06.448247 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-571b3361-2f84-43fe-bb45-561f4890c8ad tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:06.449593 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-571b3361-2f84-43fe-bb45-561f4890c8ad tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:06.450583 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-571b3361-2f84-43fe-bb45-561f4890c8ad tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:06.451346 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-571b3361-2f84-43fe-bb45-561f4890c8ad tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:06.667295 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-571b3361-2f84-43fe-bb45-561f4890c8ad tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:06.691094 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-571b3361-2f84-43fe-bb45-561f4890c8ad tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b" status: 200 len: 1269 microversion: 2.1 time: 0.305768 Sep 02 05:25:06.697050 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 186/366] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:06 2022] GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b => generated 1269 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:06.699494 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5d02d471-3200-4024-8b08-52849884d47a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:06.706393 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-39e32905-1618-4860-8c8e-3aca70f07d9b tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:06.706997 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-39e32905-1618-4860-8c8e-3aca70f07d9b tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:06.714131 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-39e32905-1618-4860-8c8e-3aca70f07d9b tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:06.714419 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-39e32905-1618-4860-8c8e-3aca70f07d9b tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:06.715071 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-39e32905-1618-4860-8c8e-3aca70f07d9b tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:06.715773 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-39e32905-1618-4860-8c8e-3aca70f07d9b tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:06.716400 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-39e32905-1618-4860-8c8e-3aca70f07d9b tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:06.716819 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-39e32905-1618-4860-8c8e-3aca70f07d9b tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:06.724285 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5d02d471-3200-4024-8b08-52849884d47a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1502 microversion: 2.1 time: 0.443657 Sep 02 05:25:06.724989 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 181/367] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:06 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1502 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:06.747165 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-058a5d0a-ca3e-481e-876f-0b755896a8da tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:06.747952 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-058a5d0a-ca3e-481e-876f-0b755896a8da tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:06.754211 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-058a5d0a-ca3e-481e-876f-0b755896a8da tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:06.754677 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-058a5d0a-ca3e-481e-876f-0b755896a8da tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:06.755109 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-058a5d0a-ca3e-481e-876f-0b755896a8da tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:06.755783 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-058a5d0a-ca3e-481e-876f-0b755896a8da tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:06.756253 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-058a5d0a-ca3e-481e-876f-0b755896a8da tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:06.756671 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-058a5d0a-ca3e-481e-876f-0b755896a8da tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:06.970892 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-39e32905-1618-4860-8c8e-3aca70f07d9b tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:06.978470 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-39e32905-1618-4860-8c8e-3aca70f07d9b tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 200 len: 1314 microversion: 2.1 time: 0.278011 Sep 02 05:25:06.979555 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 187/368] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:06 2022] GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:06.984903 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-058a5d0a-ca3e-481e-876f-0b755896a8da tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:06.993245 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-058a5d0a-ca3e-481e-876f-0b755896a8da tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1515 microversion: 2.1 time: 0.249835 Sep 02 05:25:06.994008 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 182/369] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:06 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1515 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:25:07.717143 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-7ac72725-8cf0-4d4c-9852-4f7304f13c51 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:07.718461 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-7ac72725-8cf0-4d4c-9852-4f7304f13c51 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:07.726046 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7ac72725-8cf0-4d4c-9852-4f7304f13c51 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:07.726910 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7ac72725-8cf0-4d4c-9852-4f7304f13c51 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:07.727558 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7ac72725-8cf0-4d4c-9852-4f7304f13c51 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:07.728840 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7ac72725-8cf0-4d4c-9852-4f7304f13c51 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:07.729501 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7ac72725-8cf0-4d4c-9852-4f7304f13c51 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:07.730090 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7ac72725-8cf0-4d4c-9852-4f7304f13c51 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:07.837403 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-7ac72725-8cf0-4d4c-9852-4f7304f13c51 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:07.850560 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-7ac72725-8cf0-4d4c-9852-4f7304f13c51 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b" status: 200 len: 1275 microversion: 2.1 time: 0.136567 Sep 02 05:25:07.851156 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 188/370] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:07 2022] GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b => generated 1275 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:08.003483 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-7f33021e-4596-4b19-8b5e-2e9f3903fef5 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:08.004900 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-7f33021e-4596-4b19-8b5e-2e9f3903fef5 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:08.017506 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7f33021e-4596-4b19-8b5e-2e9f3903fef5 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:08.018194 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7f33021e-4596-4b19-8b5e-2e9f3903fef5 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:08.018857 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7f33021e-4596-4b19-8b5e-2e9f3903fef5 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:08.019656 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7f33021e-4596-4b19-8b5e-2e9f3903fef5 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:08.020248 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7f33021e-4596-4b19-8b5e-2e9f3903fef5 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:08.021452 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7f33021e-4596-4b19-8b5e-2e9f3903fef5 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:08.219075 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-7f33021e-4596-4b19-8b5e-2e9f3903fef5 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:08.228613 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-7f33021e-4596-4b19-8b5e-2e9f3903fef5 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 200 len: 1314 microversion: 2.1 time: 0.232742 Sep 02 05:25:08.229797 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 183/371] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:07 2022] GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:08.874989 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-91e24cdb-d734-4288-828b-874fbded43d7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:08.876970 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-91e24cdb-d734-4288-828b-874fbded43d7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:08.884577 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-91e24cdb-d734-4288-828b-874fbded43d7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:08.885598 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-91e24cdb-d734-4288-828b-874fbded43d7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:08.886320 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-91e24cdb-d734-4288-828b-874fbded43d7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:08.887754 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-91e24cdb-d734-4288-828b-874fbded43d7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:08.888269 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-91e24cdb-d734-4288-828b-874fbded43d7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:08.888946 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-91e24cdb-d734-4288-828b-874fbded43d7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:09.033551 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-91e24cdb-d734-4288-828b-874fbded43d7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:09.042717 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-91e24cdb-d734-4288-828b-874fbded43d7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b" status: 200 len: 1317 microversion: 2.1 time: 0.171608 Sep 02 05:25:09.043288 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 189/372] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:08 2022] GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:09.249931 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-e86d194d-a149-4e25-bfc2-08849098810b tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:09.250701 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-e86d194d-a149-4e25-bfc2-08849098810b tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:09.257740 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e86d194d-a149-4e25-bfc2-08849098810b tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:09.258347 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e86d194d-a149-4e25-bfc2-08849098810b tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:09.258819 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e86d194d-a149-4e25-bfc2-08849098810b tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:09.259631 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e86d194d-a149-4e25-bfc2-08849098810b tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:09.260405 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e86d194d-a149-4e25-bfc2-08849098810b tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:09.260899 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e86d194d-a149-4e25-bfc2-08849098810b tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:09.405036 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e86d194d-a149-4e25-bfc2-08849098810b tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:09.419582 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-e86d194d-a149-4e25-bfc2-08849098810b tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 200 len: 1314 microversion: 2.1 time: 0.173423 Sep 02 05:25:09.420856 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 184/373] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:09 2022] GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:09.626652 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-0026ef04-8882-4f63-8b91-8ae182915247 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:25:09.629497 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-0026ef04-8882-4f63-8b91-8ae182915247 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:09.641338 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0026ef04-8882-4f63-8b91-8ae182915247 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:09.641950 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0026ef04-8882-4f63-8b91-8ae182915247 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:09.642486 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0026ef04-8882-4f63-8b91-8ae182915247 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:09.643290 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0026ef04-8882-4f63-8b91-8ae182915247 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:09.643788 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0026ef04-8882-4f63-8b91-8ae182915247 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:09.644384 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0026ef04-8882-4f63-8b91-8ae182915247 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:09.676417 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.objects.instance [None req-0026ef04-8882-4f63-8b91-8ae182915247 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lazy-loading 'flavor' on Instance uuid 67493ca3-e212-45fa-886f-5c2bc5239f0b {{(pid=120448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:25:09.810179 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-0026ef04-8882-4f63-8b91-8ae182915247 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "POST /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b/action" status: 200 len: 32 microversion: 2.1 time: 0.188838 Sep 02 05:25:09.810705 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 190/374] 10.222.0.30 () {60 vars in 1278 bytes} [Fri Sep 2 05:25:09 2022] POST /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b/action => generated 32 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 05:25:09.820048 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-cbfb1037-03cb-41a4-8d65-806c03b6ae3d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:09.820891 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-cbfb1037-03cb-41a4-8d65-806c03b6ae3d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:09.827016 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cbfb1037-03cb-41a4-8d65-806c03b6ae3d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:09.827627 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cbfb1037-03cb-41a4-8d65-806c03b6ae3d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:09.828190 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cbfb1037-03cb-41a4-8d65-806c03b6ae3d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:09.829030 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cbfb1037-03cb-41a4-8d65-806c03b6ae3d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:09.829585 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cbfb1037-03cb-41a4-8d65-806c03b6ae3d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:09.830086 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cbfb1037-03cb-41a4-8d65-806c03b6ae3d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:09.979274 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-cbfb1037-03cb-41a4-8d65-806c03b6ae3d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:09.987613 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-cbfb1037-03cb-41a4-8d65-806c03b6ae3d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1521 microversion: 2.1 time: 0.171329 Sep 02 05:25:09.988239 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 185/375] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:09 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:10.064771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-4c06c379-723e-41c5-957e-a3d2aea18f8f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:10.065361 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-4c06c379-723e-41c5-957e-a3d2aea18f8f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:10.073944 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4c06c379-723e-41c5-957e-a3d2aea18f8f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:10.074417 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4c06c379-723e-41c5-957e-a3d2aea18f8f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:10.075116 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4c06c379-723e-41c5-957e-a3d2aea18f8f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:10.075816 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4c06c379-723e-41c5-957e-a3d2aea18f8f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:10.076303 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4c06c379-723e-41c5-957e-a3d2aea18f8f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:10.076714 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4c06c379-723e-41c5-957e-a3d2aea18f8f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:10.233574 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-4c06c379-723e-41c5-957e-a3d2aea18f8f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:10.237856 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:10.242719 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-4c06c379-723e-41c5-957e-a3d2aea18f8f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b" status: 200 len: 1317 microversion: 2.1 time: 0.183023 Sep 02 05:25:10.243731 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 191/376] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:10 2022] GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:10.444991 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-fb252766-25ab-4b3e-a9e5-8b6d9408dac6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:10.446310 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-fb252766-25ab-4b3e-a9e5-8b6d9408dac6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:10.453769 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fb252766-25ab-4b3e-a9e5-8b6d9408dac6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:10.454968 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fb252766-25ab-4b3e-a9e5-8b6d9408dac6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:10.455635 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fb252766-25ab-4b3e-a9e5-8b6d9408dac6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:10.456575 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fb252766-25ab-4b3e-a9e5-8b6d9408dac6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:10.457452 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fb252766-25ab-4b3e-a9e5-8b6d9408dac6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:10.458073 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fb252766-25ab-4b3e-a9e5-8b6d9408dac6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:10.711283 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-fb252766-25ab-4b3e-a9e5-8b6d9408dac6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:10.723233 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-fb252766-25ab-4b3e-a9e5-8b6d9408dac6 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 200 len: 1314 microversion: 2.1 time: 0.282563 Sep 02 05:25:10.739337 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 186/377] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:10 2022] GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:11.009601 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-2cd0d2ea-23a0-4731-bb7b-c5e49b81530b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:11.010215 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-2cd0d2ea-23a0-4731-bb7b-c5e49b81530b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:11.020584 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2cd0d2ea-23a0-4731-bb7b-c5e49b81530b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:11.024039 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2cd0d2ea-23a0-4731-bb7b-c5e49b81530b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:11.024610 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2cd0d2ea-23a0-4731-bb7b-c5e49b81530b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:11.025722 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2cd0d2ea-23a0-4731-bb7b-c5e49b81530b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:11.026191 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2cd0d2ea-23a0-4731-bb7b-c5e49b81530b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:11.026615 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2cd0d2ea-23a0-4731-bb7b-c5e49b81530b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:11.266885 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-504ea8a0-268f-4d84-a16e-f5f707b73f77 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:11.267810 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-504ea8a0-268f-4d84-a16e-f5f707b73f77 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:11.281211 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-504ea8a0-268f-4d84-a16e-f5f707b73f77 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:11.283093 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-504ea8a0-268f-4d84-a16e-f5f707b73f77 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:11.284968 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-504ea8a0-268f-4d84-a16e-f5f707b73f77 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:11.285962 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-504ea8a0-268f-4d84-a16e-f5f707b73f77 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:11.287851 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-504ea8a0-268f-4d84-a16e-f5f707b73f77 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:11.289095 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-504ea8a0-268f-4d84-a16e-f5f707b73f77 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:11.450552 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-2cd0d2ea-23a0-4731-bb7b-c5e49b81530b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:11.459472 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-2cd0d2ea-23a0-4731-bb7b-c5e49b81530b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1521 microversion: 2.1 time: 0.453939 Sep 02 05:25:11.460139 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 192/378] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:11 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1521 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:11.543609 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-504ea8a0-268f-4d84-a16e-f5f707b73f77 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:11.562385 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-504ea8a0-268f-4d84-a16e-f5f707b73f77 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b" status: 200 len: 1317 microversion: 2.1 time: 0.302004 Sep 02 05:25:11.563619 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 187/379] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:11 2022] GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:11.750171 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-4bddbbdd-5d55-4e75-bf75-9cb89a1228a0 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:11.752332 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-4bddbbdd-5d55-4e75-bf75-9cb89a1228a0 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:11.770015 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4bddbbdd-5d55-4e75-bf75-9cb89a1228a0 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:11.770511 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4bddbbdd-5d55-4e75-bf75-9cb89a1228a0 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:11.770945 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4bddbbdd-5d55-4e75-bf75-9cb89a1228a0 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:11.771652 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4bddbbdd-5d55-4e75-bf75-9cb89a1228a0 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:11.772096 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4bddbbdd-5d55-4e75-bf75-9cb89a1228a0 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:11.775651 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4bddbbdd-5d55-4e75-bf75-9cb89a1228a0 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:12.015002 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-4bddbbdd-5d55-4e75-bf75-9cb89a1228a0 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:12.028475 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-4bddbbdd-5d55-4e75-bf75-9cb89a1228a0 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 200 len: 1314 microversion: 2.1 time: 0.286197 Sep 02 05:25:12.030882 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 193/380] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:11 2022] GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:12.283472 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-a9c0850f-ba51-4220-8119-b4b2d09a29dc req-3fc2473c-7a40-4499-9b47-6c4c7a22f32f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5611a5c-47c5-4f55-95d0-4c54b5af318b", "tag": "b873aab3-035f-4e63-a1ab-29afdf7c6570"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:25:12.300826 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-a9c0850f-ba51-4220-8119-b4b2d09a29dc req-3fc2473c-7a40-4499-9b47-6c4c7a22f32f service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:12.301666 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-a9c0850f-ba51-4220-8119-b4b2d09a29dc req-3fc2473c-7a40-4499-9b47-6c4c7a22f32f service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:12.302286 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-a9c0850f-ba51-4220-8119-b4b2d09a29dc req-3fc2473c-7a40-4499-9b47-6c4c7a22f32f service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:12.341443 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=100 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:12.347923 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-a9c0850f-ba51-4220-8119-b4b2d09a29dc req-3fc2473c-7a40-4499-9b47-6c4c7a22f32f service nova] Creating event network-changed:b873aab3-035f-4e63-a1ab-29afdf7c6570 for instance a5611a5c-47c5-4f55-95d0-4c54b5af318b on hv-cinder-85391 Sep 02 05:25:12.355634 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-a9c0850f-ba51-4220-8119-b4b2d09a29dc req-3fc2473c-7a40-4499-9b47-6c4c7a22f32f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077342 Sep 02 05:25:12.356720 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 188/381] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 05:25:12.482629 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-a76c9f3b-4b4f-4957-bdf7-e047b0201cfb tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:12.484500 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-a76c9f3b-4b4f-4957-bdf7-e047b0201cfb tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:12.489963 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:12.498239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a76c9f3b-4b4f-4957-bdf7-e047b0201cfb tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:12.499188 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a76c9f3b-4b4f-4957-bdf7-e047b0201cfb tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:12.499786 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a76c9f3b-4b4f-4957-bdf7-e047b0201cfb tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:12.500811 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a76c9f3b-4b4f-4957-bdf7-e047b0201cfb tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:12.501462 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a76c9f3b-4b4f-4957-bdf7-e047b0201cfb tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:12.502028 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a76c9f3b-4b4f-4957-bdf7-e047b0201cfb tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:12.591471 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-3a9b9c22-3f09-4431-8ae3-3337a06eacff tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:12.592865 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-3a9b9c22-3f09-4431-8ae3-3337a06eacff tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:12.604339 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3a9b9c22-3f09-4431-8ae3-3337a06eacff tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:12.605212 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3a9b9c22-3f09-4431-8ae3-3337a06eacff tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:12.606676 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3a9b9c22-3f09-4431-8ae3-3337a06eacff tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:12.608937 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3a9b9c22-3f09-4431-8ae3-3337a06eacff tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:12.609629 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3a9b9c22-3f09-4431-8ae3-3337a06eacff tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:12.613077 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3a9b9c22-3f09-4431-8ae3-3337a06eacff tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:13.013114 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-a76c9f3b-4b4f-4957-bdf7-e047b0201cfb tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:13.044192 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-3a9b9c22-3f09-4431-8ae3-3337a06eacff tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:13.046968 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-3a9b9c22-3f09-4431-8ae3-3337a06eacff tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b" status: 200 len: 1317 microversion: 2.1 time: 0.464535 Sep 02 05:25:13.050013 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 189/382] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:12 2022] GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b => generated 1317 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:13.052005 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-a76c9f3b-4b4f-4957-bdf7-e047b0201cfb tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1521 microversion: 2.1 time: 0.570349 Sep 02 05:25:13.052896 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 194/383] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:12 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1521 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:13.056803 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-47216425-f19c-4d2c-8c41-af596d403ced tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:13.057700 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-47216425-f19c-4d2c-8c41-af596d403ced tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:13.064881 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-47216425-f19c-4d2c-8c41-af596d403ced tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:13.065575 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-47216425-f19c-4d2c-8c41-af596d403ced tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:13.066877 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-47216425-f19c-4d2c-8c41-af596d403ced tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:13.067778 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-47216425-f19c-4d2c-8c41-af596d403ced tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:13.068567 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-47216425-f19c-4d2c-8c41-af596d403ced tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:13.069192 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-47216425-f19c-4d2c-8c41-af596d403ced tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:13.256502 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-47216425-f19c-4d2c-8c41-af596d403ced tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:13.264405 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-47216425-f19c-4d2c-8c41-af596d403ced tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 200 len: 1314 microversion: 2.1 time: 0.212807 Sep 02 05:25:13.265294 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 190/384] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:13 2022] GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:13.385301 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-3c9fccf3-b17a-4f70-a8d4-27f11e633055 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Action: 'create', calling method: .version_select at 0x7fc90b590790>, body: {"keypair": {"name": "tempest-keypair-664783107", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgGUOaxvdD5ZF5tW2dma9s7DIVNW9Cu+F2H00K6S4D64DSlKLUmLkTbxFD+kp8jxhg4xiB2+efbkHHJKNvXOgcKkl2RoTVkgkHNY2dOT3fMXoeNgYaqyio4kRomw2Aw2Q=="}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:25:13.405667 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-3c9fccf3-b17a-4f70-a8d4-27f11e633055 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Getting quotas for project 88b420db5aef422b9ea85708c2d8e108. Resources: {'key_pairs'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:25:13.412023 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-3c9fccf3-b17a-4f70-a8d4-27f11e633055 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Getting quotas for user bdba1dc4a5e9482cb4eb94d914c108bf and project 88b420db5aef422b9ea85708c2d8e108. Resources: {'key_pairs'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:25:13.451161 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-3c9fccf3-b17a-4f70-a8d4-27f11e633055 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.222467 Sep 02 05:25:13.452274 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 195/385] 10.222.0.30 () {60 vars in 1159 bytes} [Fri Sep 2 05:25:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:25:14.076021 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-4d98fbb4-2595-49c0-987c-ef3d6b23a2a4 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:14.076731 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-4d98fbb4-2595-49c0-987c-ef3d6b23a2a4 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:14.086864 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell0:SELECT=4 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:14.090579 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4d98fbb4-2595-49c0-987c-ef3d6b23a2a4 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:14.091256 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-3cb356b2-d140-443a-a3b4-5c0e28276269 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:14.091880 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4d98fbb4-2595-49c0-987c-ef3d6b23a2a4 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:14.092042 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-3cb356b2-d140-443a-a3b4-5c0e28276269 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:14.092895 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4d98fbb4-2595-49c0-987c-ef3d6b23a2a4 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:14.093823 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4d98fbb4-2595-49c0-987c-ef3d6b23a2a4 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:14.095923 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4d98fbb4-2595-49c0-987c-ef3d6b23a2a4 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:14.096642 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4d98fbb4-2595-49c0-987c-ef3d6b23a2a4 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:14.098835 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3cb356b2-d140-443a-a3b4-5c0e28276269 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:14.099428 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3cb356b2-d140-443a-a3b4-5c0e28276269 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:14.099954 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3cb356b2-d140-443a-a3b4-5c0e28276269 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:14.100733 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3cb356b2-d140-443a-a3b4-5c0e28276269 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:14.101200 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3cb356b2-d140-443a-a3b4-5c0e28276269 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:14.101630 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3cb356b2-d140-443a-a3b4-5c0e28276269 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:14.211808 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell0:SELECT=4 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:14.394518 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-3cb356b2-d140-443a-a3b4-5c0e28276269 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:14.403145 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-3cb356b2-d140-443a-a3b4-5c0e28276269 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1521 microversion: 2.1 time: 0.317503 Sep 02 05:25:14.403742 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 196/386] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:14 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:14.408786 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-2a7a21ac-a180-4be0-bce6-793de727ba76 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:14.409504 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-2a7a21ac-a180-4be0-bce6-793de727ba76 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:14.418409 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2a7a21ac-a180-4be0-bce6-793de727ba76 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:14.418969 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2a7a21ac-a180-4be0-bce6-793de727ba76 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:14.419803 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2a7a21ac-a180-4be0-bce6-793de727ba76 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:14.421177 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2a7a21ac-a180-4be0-bce6-793de727ba76 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:14.424998 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2a7a21ac-a180-4be0-bce6-793de727ba76 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:14.425468 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2a7a21ac-a180-4be0-bce6-793de727ba76 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:14.432419 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-4d98fbb4-2595-49c0-987c-ef3d6b23a2a4 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:14.443166 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-4d98fbb4-2595-49c0-987c-ef3d6b23a2a4 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b" status: 200 len: 1317 microversion: 2.1 time: 0.371097 Sep 02 05:25:14.448095 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 191/387] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:14 2022] GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b => generated 1317 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:14.680624 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-2a7a21ac-a180-4be0-bce6-793de727ba76 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:14.695291 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-2a7a21ac-a180-4be0-bce6-793de727ba76 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 200 len: 1314 microversion: 2.1 time: 0.290113 Sep 02 05:25:14.695882 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 197/388] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:14 2022] GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:15.426050 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-485474a9-068a-461f-ba74-e09dbadeba44 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:15.426729 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-485474a9-068a-461f-ba74-e09dbadeba44 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:15.433343 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-485474a9-068a-461f-ba74-e09dbadeba44 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:15.436332 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-485474a9-068a-461f-ba74-e09dbadeba44 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:15.437143 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-485474a9-068a-461f-ba74-e09dbadeba44 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:15.438734 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-485474a9-068a-461f-ba74-e09dbadeba44 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:15.439440 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-485474a9-068a-461f-ba74-e09dbadeba44 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:15.440089 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-485474a9-068a-461f-ba74-e09dbadeba44 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:15.454929 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-14ff7526-36f7-44b0-b24c-97997915f527 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1374853826", "imageRef": "f3669111-2e3f-4f39-878f-19d263505eaa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "239438af-7bb7-4d71-98ef-7302bb97e27b"}], "security_groups": [{"name": "tempest-securitygroup--1839849847"}], "key_name": "tempest-keypair-664783107", "user_data": "}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:25:15.660137 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.network.neutron [None req-14ff7526-36f7-44b0-b24c-97997915f527 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] validate_networks() for [('239438af-7bb7-4d71-98ef-7302bb97e27b', None, None, None, None, None)] {{(pid=120448) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 05:25:15.771756 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-485474a9-068a-461f-ba74-e09dbadeba44 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:15.783284 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-485474a9-068a-461f-ba74-e09dbadeba44 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1521 microversion: 2.1 time: 0.361212 Sep 02 05:25:15.783861 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 192/389] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:15 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:15.798057 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-0b718626-010d-442d-a62e-5dc9760f1fe3 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:15.800988 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-0b718626-010d-442d-a62e-5dc9760f1fe3 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:15.807467 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0b718626-010d-442d-a62e-5dc9760f1fe3 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:15.808049 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0b718626-010d-442d-a62e-5dc9760f1fe3 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:15.808509 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0b718626-010d-442d-a62e-5dc9760f1fe3 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:15.809306 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0b718626-010d-442d-a62e-5dc9760f1fe3 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:15.809997 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0b718626-010d-442d-a62e-5dc9760f1fe3 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:15.810425 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0b718626-010d-442d-a62e-5dc9760f1fe3 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:16.091378 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-0b718626-010d-442d-a62e-5dc9760f1fe3 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:16.105053 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-0b718626-010d-442d-a62e-5dc9760f1fe3 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b" status: 200 len: 1317 microversion: 2.1 time: 0.319279 Sep 02 05:25:16.105931 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 193/390] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:15 2022] GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b => generated 1317 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:16.114530 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-79457c5a-04a7-43e2-aca2-8fffbe9cb27f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:16.115570 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-79457c5a-04a7-43e2-aca2-8fffbe9cb27f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:16.127510 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-79457c5a-04a7-43e2-aca2-8fffbe9cb27f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:16.127995 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-79457c5a-04a7-43e2-aca2-8fffbe9cb27f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:16.128651 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-79457c5a-04a7-43e2-aca2-8fffbe9cb27f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:16.129507 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-79457c5a-04a7-43e2-aca2-8fffbe9cb27f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:16.130104 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-79457c5a-04a7-43e2-aca2-8fffbe9cb27f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:16.130667 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-79457c5a-04a7-43e2-aca2-8fffbe9cb27f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:16.363547 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-14ff7526-36f7-44b0-b24c-97997915f527 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Flavor limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 05:25:16.364335 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-14ff7526-36f7-44b0-b24c-97997915f527 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Image limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 05:25:16.365042 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-14ff7526-36f7-44b0-b24c-97997915f527 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Flavor pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 05:25:16.365655 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-14ff7526-36f7-44b0-b24c-97997915f527 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Image pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 05:25:16.366296 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-14ff7526-36f7-44b0-b24c-97997915f527 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 05:25:16.376293 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-14ff7526-36f7-44b0-b24c-97997915f527 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:16.376501 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-79457c5a-04a7-43e2-aca2-8fffbe9cb27f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:16.377244 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-14ff7526-36f7-44b0-b24c-97997915f527 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:16.379734 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-14ff7526-36f7-44b0-b24c-97997915f527 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:16.381819 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-14ff7526-36f7-44b0-b24c-97997915f527 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:16.382512 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-14ff7526-36f7-44b0-b24c-97997915f527 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:16.383616 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-14ff7526-36f7-44b0-b24c-97997915f527 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:16.385276 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-79457c5a-04a7-43e2-aca2-8fffbe9cb27f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 200 len: 1314 microversion: 2.1 time: 0.277865 Sep 02 05:25:16.385845 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 194/391] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:16 2022] GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:16.390500 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-5e201691-cd82-40b6-b934-63cea65602de req-deee2266-3f7c-41cc-ae7d-b6d6bee3f48c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de", "name": "network-vif-plugged", "status": "completed", "tag": "c2607880-31ef-4eba-b1cd-89f6200c26a5"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:25:16.400844 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-5e201691-cd82-40b6-b934-63cea65602de req-deee2266-3f7c-41cc-ae7d-b6d6bee3f48c service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:16.401322 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-5e201691-cd82-40b6-b934-63cea65602de req-deee2266-3f7c-41cc-ae7d-b6d6bee3f48c service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:16.401741 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-5e201691-cd82-40b6-b934-63cea65602de req-deee2266-3f7c-41cc-ae7d-b6d6bee3f48c service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:16.414495 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-5e201691-cd82-40b6-b934-63cea65602de req-deee2266-3f7c-41cc-ae7d-b6d6bee3f48c service nova] Creating event network-vif-plugged:c2607880-31ef-4eba-b1cd-89f6200c26a5 for instance ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de on hv-cinder-85391 Sep 02 05:25:16.416499 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-14ff7526-36f7-44b0-b24c-97997915f527 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Getting quotas for project 88b420db5aef422b9ea85708c2d8e108. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:25:16.421252 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-5e201691-cd82-40b6-b934-63cea65602de req-deee2266-3f7c-41cc-ae7d-b6d6bee3f48c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033788 Sep 02 05:25:16.422040 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-14ff7526-36f7-44b0-b24c-97997915f527 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Getting quotas for user bdba1dc4a5e9482cb4eb94d914c108bf and project 88b420db5aef422b9ea85708c2d8e108. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:25:16.422256 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 195/392] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:25:16.435625 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-14ff7526-36f7-44b0-b24c-97997915f527 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Going to run 1 instances... {{(pid=120448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 05:25:16.437991 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-14ff7526-36f7-44b0-b24c-97997915f527 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3669111-2e3f-4f39-878f-19d263505eaa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 05:25:16.493078 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-14ff7526-36f7-44b0-b24c-97997915f527 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.043655 Sep 02 05:25:16.494552 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 198/393] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Sep 2 05:25:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 1046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 02 05:25:16.506990 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-1258346a-1a0b-4f6f-b950-0c5462449622 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:16.507770 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-1258346a-1a0b-4f6f-b950-0c5462449622 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:16.569698 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1258346a-1a0b-4f6f-b950-0c5462449622 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:16.577352 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-1258346a-1a0b-4f6f-b950-0c5462449622 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1237 microversion: 2.1 time: 0.074804 Sep 02 05:25:16.578245 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 196/394] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:16 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1237 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:16.803949 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d9960e03-cb7c-49cf-9185-3c1be8d13f2a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:16.805054 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-d9960e03-cb7c-49cf-9185-3c1be8d13f2a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:16.812958 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d9960e03-cb7c-49cf-9185-3c1be8d13f2a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:16.813569 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d9960e03-cb7c-49cf-9185-3c1be8d13f2a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:16.814102 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d9960e03-cb7c-49cf-9185-3c1be8d13f2a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:16.814935 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d9960e03-cb7c-49cf-9185-3c1be8d13f2a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:16.815478 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d9960e03-cb7c-49cf-9185-3c1be8d13f2a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:16.816007 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d9960e03-cb7c-49cf-9185-3c1be8d13f2a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:16.969522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d9960e03-cb7c-49cf-9185-3c1be8d13f2a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:16.978765 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-d9960e03-cb7c-49cf-9185-3c1be8d13f2a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1521 microversion: 2.1 time: 0.178648 Sep 02 05:25:16.979341 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 199/395] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:16 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:17.126631 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-bad29f36-d83d-402b-b732-56462367b37e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:17.127329 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-bad29f36-d83d-402b-b732-56462367b37e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:17.133590 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bad29f36-d83d-402b-b732-56462367b37e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:17.134201 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bad29f36-d83d-402b-b732-56462367b37e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:17.134738 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bad29f36-d83d-402b-b732-56462367b37e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:17.135482 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bad29f36-d83d-402b-b732-56462367b37e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:17.136142 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bad29f36-d83d-402b-b732-56462367b37e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:17.136565 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bad29f36-d83d-402b-b732-56462367b37e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:17.274037 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-bad29f36-d83d-402b-b732-56462367b37e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:17.281893 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-bad29f36-d83d-402b-b732-56462367b37e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b" status: 200 len: 1317 microversion: 2.1 time: 0.159643 Sep 02 05:25:17.282458 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 197/396] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:17 2022] GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:25:17.406377 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-e07ff888-637b-4699-b3a0-947d3b1870e2 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:17.407005 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-e07ff888-637b-4699-b3a0-947d3b1870e2 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:17.412893 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e07ff888-637b-4699-b3a0-947d3b1870e2 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:17.413582 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e07ff888-637b-4699-b3a0-947d3b1870e2 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:17.414009 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e07ff888-637b-4699-b3a0-947d3b1870e2 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:17.414724 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e07ff888-637b-4699-b3a0-947d3b1870e2 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:17.415375 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e07ff888-637b-4699-b3a0-947d3b1870e2 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:17.415792 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e07ff888-637b-4699-b3a0-947d3b1870e2 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:17.557636 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-e07ff888-637b-4699-b3a0-947d3b1870e2 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:17.565416 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-e07ff888-637b-4699-b3a0-947d3b1870e2 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 200 len: 1314 microversion: 2.1 time: 0.163052 Sep 02 05:25:17.568151 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 200/397] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:17 2022] GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:17.605171 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ee3cb010-1678-4a2f-8838-1ba4981e545f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:17.605797 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-ee3cb010-1678-4a2f-8838-1ba4981e545f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:17.611946 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ee3cb010-1678-4a2f-8838-1ba4981e545f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:17.612458 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ee3cb010-1678-4a2f-8838-1ba4981e545f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:17.612882 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ee3cb010-1678-4a2f-8838-1ba4981e545f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:17.613563 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ee3cb010-1678-4a2f-8838-1ba4981e545f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:17.614005 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ee3cb010-1678-4a2f-8838-1ba4981e545f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:17.614418 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ee3cb010-1678-4a2f-8838-1ba4981e545f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:17.678857 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ee3cb010-1678-4a2f-8838-1ba4981e545f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:17.686791 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-ee3cb010-1678-4a2f-8838-1ba4981e545f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1241 microversion: 2.1 time: 0.085899 Sep 02 05:25:17.687333 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 198/398] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:17 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:17.999392 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-be424216-9afb-486b-9733-a19744731272 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:18.000439 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-be424216-9afb-486b-9733-a19744731272 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:18.007847 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-be424216-9afb-486b-9733-a19744731272 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:18.008413 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-be424216-9afb-486b-9733-a19744731272 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:18.009191 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-be424216-9afb-486b-9733-a19744731272 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:18.010238 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-be424216-9afb-486b-9733-a19744731272 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:18.010768 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-be424216-9afb-486b-9733-a19744731272 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:18.011257 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-be424216-9afb-486b-9733-a19744731272 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:18.170826 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-be424216-9afb-486b-9733-a19744731272 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:18.178906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-be424216-9afb-486b-9733-a19744731272 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1521 microversion: 2.1 time: 0.183470 Sep 02 05:25:18.179481 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 201/399] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:17 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:18.302465 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-79b7e00b-7926-419d-8f0d-b24a54b3e150 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:18.303199 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-79b7e00b-7926-419d-8f0d-b24a54b3e150 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:18.309676 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-79b7e00b-7926-419d-8f0d-b24a54b3e150 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:18.310193 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-79b7e00b-7926-419d-8f0d-b24a54b3e150 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:18.310623 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-79b7e00b-7926-419d-8f0d-b24a54b3e150 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:18.311336 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-79b7e00b-7926-419d-8f0d-b24a54b3e150 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:18.311833 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-79b7e00b-7926-419d-8f0d-b24a54b3e150 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:18.312293 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-79b7e00b-7926-419d-8f0d-b24a54b3e150 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:18.443341 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-79b7e00b-7926-419d-8f0d-b24a54b3e150 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:18.454849 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-79b7e00b-7926-419d-8f0d-b24a54b3e150 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b" status: 200 len: 1317 microversion: 2.1 time: 0.156003 Sep 02 05:25:18.455631 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 199/400] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:18 2022] GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:18.589598 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-67743cfd-eab5-4476-b860-d2f81d029375 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:18.590600 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-67743cfd-eab5-4476-b860-d2f81d029375 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:18.601598 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-67743cfd-eab5-4476-b860-d2f81d029375 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:18.602400 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-67743cfd-eab5-4476-b860-d2f81d029375 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:18.603143 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-67743cfd-eab5-4476-b860-d2f81d029375 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:18.603838 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-67743cfd-eab5-4476-b860-d2f81d029375 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:18.604329 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-67743cfd-eab5-4476-b860-d2f81d029375 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:18.604750 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-67743cfd-eab5-4476-b860-d2f81d029375 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:18.707182 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-fcd7de15-8547-435b-b004-98f0f73c8bf1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:18.708469 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-fcd7de15-8547-435b-b004-98f0f73c8bf1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:18.715241 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fcd7de15-8547-435b-b004-98f0f73c8bf1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:18.716376 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fcd7de15-8547-435b-b004-98f0f73c8bf1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:18.716965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fcd7de15-8547-435b-b004-98f0f73c8bf1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:18.718155 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fcd7de15-8547-435b-b004-98f0f73c8bf1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:18.718768 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fcd7de15-8547-435b-b004-98f0f73c8bf1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:18.719353 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fcd7de15-8547-435b-b004-98f0f73c8bf1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:18.751606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-67743cfd-eab5-4476-b860-d2f81d029375 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:18.767608 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-67743cfd-eab5-4476-b860-d2f81d029375 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 200 len: 1314 microversion: 2.1 time: 0.184271 Sep 02 05:25:18.777743 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 202/401] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:18 2022] GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:18.784822 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-fcd7de15-8547-435b-b004-98f0f73c8bf1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:18.793450 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-fcd7de15-8547-435b-b004-98f0f73c8bf1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1289 microversion: 2.1 time: 0.090389 Sep 02 05:25:18.794219 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 200/402] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:18 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:25:19.202175 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-096afad5-052e-4b29-9ea2-7e3c9c29c94f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:19.203037 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-096afad5-052e-4b29-9ea2-7e3c9c29c94f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:19.209721 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-096afad5-052e-4b29-9ea2-7e3c9c29c94f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:19.210249 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-096afad5-052e-4b29-9ea2-7e3c9c29c94f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:19.210675 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-096afad5-052e-4b29-9ea2-7e3c9c29c94f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:19.211352 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-096afad5-052e-4b29-9ea2-7e3c9c29c94f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:19.211796 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-096afad5-052e-4b29-9ea2-7e3c9c29c94f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:19.212320 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-096afad5-052e-4b29-9ea2-7e3c9c29c94f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:19.348102 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-096afad5-052e-4b29-9ea2-7e3c9c29c94f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:19.357476 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-096afad5-052e-4b29-9ea2-7e3c9c29c94f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1521 microversion: 2.1 time: 0.160297 Sep 02 05:25:19.372917 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 203/403] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:19 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:19.477639 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-e7676336-d29f-4afa-a0fa-4ae4f02e6a3f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:19.478319 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-e7676336-d29f-4afa-a0fa-4ae4f02e6a3f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:19.484210 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e7676336-d29f-4afa-a0fa-4ae4f02e6a3f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:19.484690 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e7676336-d29f-4afa-a0fa-4ae4f02e6a3f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:19.485123 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e7676336-d29f-4afa-a0fa-4ae4f02e6a3f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:19.485804 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e7676336-d29f-4afa-a0fa-4ae4f02e6a3f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:19.486272 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e7676336-d29f-4afa-a0fa-4ae4f02e6a3f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:19.486685 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e7676336-d29f-4afa-a0fa-4ae4f02e6a3f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:19.631728 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e7676336-d29f-4afa-a0fa-4ae4f02e6a3f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:19.639589 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-e7676336-d29f-4afa-a0fa-4ae4f02e6a3f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b" status: 200 len: 1317 microversion: 2.1 time: 0.165722 Sep 02 05:25:19.640183 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 201/404] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:19 2022] GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:19.790256 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d097d50b-5bed-4f06-84db-698dae5b78bb tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:19.791520 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-d097d50b-5bed-4f06-84db-698dae5b78bb tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:19.798512 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d097d50b-5bed-4f06-84db-698dae5b78bb tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:19.799017 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d097d50b-5bed-4f06-84db-698dae5b78bb tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:19.799501 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d097d50b-5bed-4f06-84db-698dae5b78bb tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:19.800269 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d097d50b-5bed-4f06-84db-698dae5b78bb tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:19.800777 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d097d50b-5bed-4f06-84db-698dae5b78bb tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:19.801206 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d097d50b-5bed-4f06-84db-698dae5b78bb tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:19.817959 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-dcfce864-0c9a-4d57-927a-3bf84e98deb6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:19.818561 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-dcfce864-0c9a-4d57-927a-3bf84e98deb6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:19.825277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dcfce864-0c9a-4d57-927a-3bf84e98deb6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:19.825811 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dcfce864-0c9a-4d57-927a-3bf84e98deb6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:19.826343 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dcfce864-0c9a-4d57-927a-3bf84e98deb6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:19.827102 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dcfce864-0c9a-4d57-927a-3bf84e98deb6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:19.827620 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dcfce864-0c9a-4d57-927a-3bf84e98deb6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:19.828156 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dcfce864-0c9a-4d57-927a-3bf84e98deb6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:19.904203 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-dcfce864-0c9a-4d57-927a-3bf84e98deb6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:19.912268 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-dcfce864-0c9a-4d57-927a-3bf84e98deb6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1289 microversion: 2.1 time: 0.098352 Sep 02 05:25:19.912840 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 202/405] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:19 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1289 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:19.917281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-57a396d0-91df-4674-8c72-99c7793ce19e req-ff30bede-7627-4413-8afa-c9bbc18afcce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5611a5c-47c5-4f55-95d0-4c54b5af318b", "name": "network-vif-plugged", "status": "completed", "tag": "b873aab3-035f-4e63-a1ab-29afdf7c6570"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:25:19.927143 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-57a396d0-91df-4674-8c72-99c7793ce19e req-ff30bede-7627-4413-8afa-c9bbc18afcce service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:19.927634 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-57a396d0-91df-4674-8c72-99c7793ce19e req-ff30bede-7627-4413-8afa-c9bbc18afcce service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:19.928049 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-57a396d0-91df-4674-8c72-99c7793ce19e req-ff30bede-7627-4413-8afa-c9bbc18afcce service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:19.939358 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-57a396d0-91df-4674-8c72-99c7793ce19e req-ff30bede-7627-4413-8afa-c9bbc18afcce service nova] Creating event network-vif-plugged:b873aab3-035f-4e63-a1ab-29afdf7c6570 for instance a5611a5c-47c5-4f55-95d0-4c54b5af318b on hv-cinder-85391 Sep 02 05:25:19.944579 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-57a396d0-91df-4674-8c72-99c7793ce19e req-ff30bede-7627-4413-8afa-c9bbc18afcce service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030434 Sep 02 05:25:19.945241 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 203/406] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:25:19.964372 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d097d50b-5bed-4f06-84db-698dae5b78bb tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:19.972685 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-d097d50b-5bed-4f06-84db-698dae5b78bb tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 200 len: 1314 microversion: 2.1 time: 0.186812 Sep 02 05:25:19.973312 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 204/407] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:19 2022] GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:20.383240 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-55af494f-5bed-4712-b069-434017d188ee tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:20.384407 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-55af494f-5bed-4712-b069-434017d188ee tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:20.391015 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-55af494f-5bed-4712-b069-434017d188ee tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:20.391466 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-55af494f-5bed-4712-b069-434017d188ee tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:20.391922 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-55af494f-5bed-4712-b069-434017d188ee tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:20.392632 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-55af494f-5bed-4712-b069-434017d188ee tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:20.393084 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-55af494f-5bed-4712-b069-434017d188ee tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:20.393503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-55af494f-5bed-4712-b069-434017d188ee tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:20.508391 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-7b50196d-834f-467e-8a98-2bfaf4581bfe tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1887479714", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1688213221", "security_groups": [{"name": "tempest-secgroup-smoke-147227411"}], "networks": [{"uuid": "01534203-e378-4faf-8dcf-f36df6900f6d"}], "block_device_mapping_v2": [{"uuid": "8be1c593-e323-4af9-80b4-edb1e9487106", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:25:20.529237 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-55af494f-5bed-4712-b069-434017d188ee tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:20.537223 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-55af494f-5bed-4712-b069-434017d188ee tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1521 microversion: 2.1 time: 0.161048 Sep 02 05:25:20.537785 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 204/408] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:20 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:20.620912 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.network.neutron [None req-7b50196d-834f-467e-8a98-2bfaf4581bfe tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] validate_networks() for [('01534203-e378-4faf-8dcf-f36df6900f6d', None, None, None, None, None)] {{(pid=120448) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 05:25:20.660322 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-3bb46423-7913-4f51-b764-3664363138a7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:20.660931 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-3bb46423-7913-4f51-b764-3664363138a7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:20.667211 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3bb46423-7913-4f51-b764-3664363138a7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:20.667694 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3bb46423-7913-4f51-b764-3664363138a7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:20.668150 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3bb46423-7913-4f51-b764-3664363138a7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:20.668852 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3bb46423-7913-4f51-b764-3664363138a7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:20.669296 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3bb46423-7913-4f51-b764-3664363138a7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:20.669714 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3bb46423-7913-4f51-b764-3664363138a7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:20.862307 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-3bb46423-7913-4f51-b764-3664363138a7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:20.870647 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-3bb46423-7913-4f51-b764-3664363138a7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b" status: 200 len: 1317 microversion: 2.1 time: 0.214248 Sep 02 05:25:20.871334 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 205/409] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:20 2022] GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:25:20.932480 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-254fddd8-2f90-49d3-915e-59ee3d8fdfe0 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:20.933134 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-254fddd8-2f90-49d3-915e-59ee3d8fdfe0 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:20.939356 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-254fddd8-2f90-49d3-915e-59ee3d8fdfe0 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:20.940068 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-254fddd8-2f90-49d3-915e-59ee3d8fdfe0 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:20.940631 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-254fddd8-2f90-49d3-915e-59ee3d8fdfe0 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:20.941332 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-254fddd8-2f90-49d3-915e-59ee3d8fdfe0 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:20.941783 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-254fddd8-2f90-49d3-915e-59ee3d8fdfe0 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:20.942202 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-254fddd8-2f90-49d3-915e-59ee3d8fdfe0 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:21.018183 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-254fddd8-2f90-49d3-915e-59ee3d8fdfe0 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:21.026057 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-254fddd8-2f90-49d3-915e-59ee3d8fdfe0 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1289 microversion: 2.1 time: 0.097604 Sep 02 05:25:21.026632 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 206/410] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:20 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1289 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:21.030995 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-1e236891-b688-44e0-b9f6-264ca83a3601 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:21.031593 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-1e236891-b688-44e0-b9f6-264ca83a3601 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:21.037794 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1e236891-b688-44e0-b9f6-264ca83a3601 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:21.038291 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1e236891-b688-44e0-b9f6-264ca83a3601 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:21.038705 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1e236891-b688-44e0-b9f6-264ca83a3601 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:21.039438 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1e236891-b688-44e0-b9f6-264ca83a3601 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:21.039886 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1e236891-b688-44e0-b9f6-264ca83a3601 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:21.040445 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1e236891-b688-44e0-b9f6-264ca83a3601 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:21.116413 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-7b50196d-834f-467e-8a98-2bfaf4581bfe tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Flavor limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 05:25:21.116922 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-7b50196d-834f-467e-8a98-2bfaf4581bfe tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Image limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 05:25:21.117525 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-7b50196d-834f-467e-8a98-2bfaf4581bfe tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Flavor pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 05:25:21.118308 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-7b50196d-834f-467e-8a98-2bfaf4581bfe tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Image pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 05:25:21.118780 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-7b50196d-834f-467e-8a98-2bfaf4581bfe tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 05:25:21.124661 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell0:SELECT=27 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:21.128903 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7b50196d-834f-467e-8a98-2bfaf4581bfe tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:21.129402 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7b50196d-834f-467e-8a98-2bfaf4581bfe tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:21.129826 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7b50196d-834f-467e-8a98-2bfaf4581bfe tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:21.130552 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7b50196d-834f-467e-8a98-2bfaf4581bfe tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:21.130982 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7b50196d-834f-467e-8a98-2bfaf4581bfe tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:21.131395 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7b50196d-834f-467e-8a98-2bfaf4581bfe tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:21.149534 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-7b50196d-834f-467e-8a98-2bfaf4581bfe tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Getting quotas for project 7edadaa7db8145ab9ddb2d2ed4a3a5df. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:25:21.153971 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-7b50196d-834f-467e-8a98-2bfaf4581bfe tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Getting quotas for user 268723dc1de74a53b6379fae0626e02b and project 7edadaa7db8145ab9ddb2d2ed4a3a5df. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:25:21.178355 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1e236891-b688-44e0-b9f6-264ca83a3601 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:21.182479 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=100 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:21.187688 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-1e236891-b688-44e0-b9f6-264ca83a3601 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 200 len: 1314 microversion: 2.1 time: 0.160073 Sep 02 05:25:21.188211 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 207/411] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:21 2022] GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:21.216147 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-7b50196d-834f-467e-8a98-2bfaf4581bfe tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Going to run 1 instances... {{(pid=120448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 05:25:21.219101 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-7b50196d-834f-467e-8a98-2bfaf4581bfe tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8be1c593-e323-4af9-80b4-edb1e9487106',volume_size=None,volume_type=None)] {{(pid=120448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 05:25:21.359817 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-7b50196d-834f-467e-8a98-2bfaf4581bfe tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.855247 Sep 02 05:25:21.360586 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 205/412] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Sep 2 05:25:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 02 05:25:21.371890 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5c14d1dc-1ab9-498a-8352-0e9228093286 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:21.372591 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5c14d1dc-1ab9-498a-8352-0e9228093286 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:21.430394 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5c14d1dc-1ab9-498a-8352-0e9228093286 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:21.437784 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5c14d1dc-1ab9-498a-8352-0e9228093286 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1089 microversion: 2.1 time: 0.070090 Sep 02 05:25:21.438478 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 208/413] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:21 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1089 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:21.557878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-efa773f1-6978-45c6-a883-df43b442a626 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:21.558763 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-efa773f1-6978-45c6-a883-df43b442a626 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:21.567503 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-efa773f1-6978-45c6-a883-df43b442a626 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:21.567996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-efa773f1-6978-45c6-a883-df43b442a626 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:21.568497 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-efa773f1-6978-45c6-a883-df43b442a626 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:21.569286 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-efa773f1-6978-45c6-a883-df43b442a626 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:21.569952 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-efa773f1-6978-45c6-a883-df43b442a626 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:21.570518 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-efa773f1-6978-45c6-a883-df43b442a626 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:21.706688 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-efa773f1-6978-45c6-a883-df43b442a626 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:21.715031 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-efa773f1-6978-45c6-a883-df43b442a626 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1521 microversion: 2.1 time: 0.160884 Sep 02 05:25:21.715397 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 206/414] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:21 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:21.892649 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-f4c06d70-47a3-42e4-a13f-fe2faa4e1dbb tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:21.893287 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-f4c06d70-47a3-42e4-a13f-fe2faa4e1dbb tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:21.900058 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f4c06d70-47a3-42e4-a13f-fe2faa4e1dbb tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:21.900571 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f4c06d70-47a3-42e4-a13f-fe2faa4e1dbb tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:21.901034 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f4c06d70-47a3-42e4-a13f-fe2faa4e1dbb tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:21.901764 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f4c06d70-47a3-42e4-a13f-fe2faa4e1dbb tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:21.902218 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f4c06d70-47a3-42e4-a13f-fe2faa4e1dbb tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:21.902644 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f4c06d70-47a3-42e4-a13f-fe2faa4e1dbb tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:22.046895 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-58d1bd2d-5af5-4493-9968-547845502539 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:22.047527 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-58d1bd2d-5af5-4493-9968-547845502539 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:22.047960 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-f4c06d70-47a3-42e4-a13f-fe2faa4e1dbb tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:22.053904 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-58d1bd2d-5af5-4493-9968-547845502539 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:22.054388 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-58d1bd2d-5af5-4493-9968-547845502539 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:22.054815 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-58d1bd2d-5af5-4493-9968-547845502539 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:22.055502 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-58d1bd2d-5af5-4493-9968-547845502539 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:22.055968 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-f4c06d70-47a3-42e4-a13f-fe2faa4e1dbb tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b" status: 200 len: 1317 microversion: 2.1 time: 0.167216 Sep 02 05:25:22.056084 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-58d1bd2d-5af5-4493-9968-547845502539 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:22.056531 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-58d1bd2d-5af5-4493-9968-547845502539 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:22.056680 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 209/415] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:21 2022] GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:22.122167 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-58d1bd2d-5af5-4493-9968-547845502539 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:22.133162 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-58d1bd2d-5af5-4493-9968-547845502539 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1289 microversion: 2.1 time: 0.089898 Sep 02 05:25:22.133953 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 207/416] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:22 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:22.211492 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-aa673dd8-a004-4899-9eab-1d9b8f544190 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:22.212399 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-aa673dd8-a004-4899-9eab-1d9b8f544190 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:22.214322 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_api:SELECT=100 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:22.219757 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-aa673dd8-a004-4899-9eab-1d9b8f544190 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:22.220254 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-aa673dd8-a004-4899-9eab-1d9b8f544190 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:22.220686 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-aa673dd8-a004-4899-9eab-1d9b8f544190 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:22.221468 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-aa673dd8-a004-4899-9eab-1d9b8f544190 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:22.221928 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-aa673dd8-a004-4899-9eab-1d9b8f544190 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:22.222346 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-aa673dd8-a004-4899-9eab-1d9b8f544190 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:22.350825 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-aa673dd8-a004-4899-9eab-1d9b8f544190 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:22.358835 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-aa673dd8-a004-4899-9eab-1d9b8f544190 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 200 len: 1314 microversion: 2.1 time: 0.151243 Sep 02 05:25:22.359399 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 210/417] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:22 2022] GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:22.458220 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-b29b49b5-5a29-4222-a327-9867b578fc5a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:22.458831 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-b29b49b5-5a29-4222-a327-9867b578fc5a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:22.465517 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b29b49b5-5a29-4222-a327-9867b578fc5a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:22.465517 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b29b49b5-5a29-4222-a327-9867b578fc5a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:22.465981 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b29b49b5-5a29-4222-a327-9867b578fc5a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:22.466650 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b29b49b5-5a29-4222-a327-9867b578fc5a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:22.467100 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b29b49b5-5a29-4222-a327-9867b578fc5a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:22.467520 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b29b49b5-5a29-4222-a327-9867b578fc5a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:22.528141 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-b29b49b5-5a29-4222-a327-9867b578fc5a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:22.535844 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-b29b49b5-5a29-4222-a327-9867b578fc5a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1139 microversion: 2.1 time: 0.081533 Sep 02 05:25:22.536437 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 208/418] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:22 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:22.737409 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-daafc988-49c9-49d6-b1ef-4617e80f67d2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:22.738041 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-daafc988-49c9-49d6-b1ef-4617e80f67d2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:22.745224 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-daafc988-49c9-49d6-b1ef-4617e80f67d2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:22.745705 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-daafc988-49c9-49d6-b1ef-4617e80f67d2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:22.746131 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-daafc988-49c9-49d6-b1ef-4617e80f67d2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:22.746808 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-daafc988-49c9-49d6-b1ef-4617e80f67d2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:22.747254 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-daafc988-49c9-49d6-b1ef-4617e80f67d2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:22.747670 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-daafc988-49c9-49d6-b1ef-4617e80f67d2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:22.881741 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-daafc988-49c9-49d6-b1ef-4617e80f67d2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:22.893303 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-daafc988-49c9-49d6-b1ef-4617e80f67d2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1521 microversion: 2.1 time: 0.159633 Sep 02 05:25:22.893905 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 211/419] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:22 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:23.077213 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-9c262c8d-cc78-476f-a88e-fd884e5bbfc2 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:23.077722 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-9c262c8d-cc78-476f-a88e-fd884e5bbfc2 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:23.084731 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9c262c8d-cc78-476f-a88e-fd884e5bbfc2 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:23.085735 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9c262c8d-cc78-476f-a88e-fd884e5bbfc2 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:23.085735 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9c262c8d-cc78-476f-a88e-fd884e5bbfc2 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:23.086319 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9c262c8d-cc78-476f-a88e-fd884e5bbfc2 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:23.086763 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9c262c8d-cc78-476f-a88e-fd884e5bbfc2 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:23.087161 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9c262c8d-cc78-476f-a88e-fd884e5bbfc2 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:23.160474 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-0a825a73-02f9-4a88-9301-37537056604f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:23.161176 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-0a825a73-02f9-4a88-9301-37537056604f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:23.167592 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0a825a73-02f9-4a88-9301-37537056604f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:23.167994 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0a825a73-02f9-4a88-9301-37537056604f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:23.168448 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0a825a73-02f9-4a88-9301-37537056604f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:23.169120 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0a825a73-02f9-4a88-9301-37537056604f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:23.169625 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0a825a73-02f9-4a88-9301-37537056604f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:23.170046 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0a825a73-02f9-4a88-9301-37537056604f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:23.225623 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-9c262c8d-cc78-476f-a88e-fd884e5bbfc2 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:23.233816 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-9c262c8d-cc78-476f-a88e-fd884e5bbfc2 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b" status: 200 len: 1317 microversion: 2.1 time: 0.160534 Sep 02 05:25:23.234378 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 209/420] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:23 2022] GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:23.242090 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-0a825a73-02f9-4a88-9301-37537056604f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:23.251328 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-0a825a73-02f9-4a88-9301-37537056604f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1289 microversion: 2.1 time: 0.094877 Sep 02 05:25:23.251905 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 212/421] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:23 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1289 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:23.384028 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-242e3952-9fa4-45e7-8571-b7f9e5940443 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:23.384843 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-242e3952-9fa4-45e7-8571-b7f9e5940443 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:23.391994 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-242e3952-9fa4-45e7-8571-b7f9e5940443 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:23.392629 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-242e3952-9fa4-45e7-8571-b7f9e5940443 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:23.393138 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-242e3952-9fa4-45e7-8571-b7f9e5940443 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:23.393934 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-242e3952-9fa4-45e7-8571-b7f9e5940443 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:23.394460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-242e3952-9fa4-45e7-8571-b7f9e5940443 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:23.394963 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-242e3952-9fa4-45e7-8571-b7f9e5940443 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:23.530170 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-242e3952-9fa4-45e7-8571-b7f9e5940443 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:23.533623 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=100 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:23.538417 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-242e3952-9fa4-45e7-8571-b7f9e5940443 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 200 len: 1314 microversion: 2.1 time: 0.160799 Sep 02 05:25:23.538996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 210/422] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:23 2022] GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:23.555354 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-680c730b-db13-424e-af97-cfa9041fe901 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:23.556031 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-680c730b-db13-424e-af97-cfa9041fe901 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:23.563863 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-680c730b-db13-424e-af97-cfa9041fe901 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:23.564774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-680c730b-db13-424e-af97-cfa9041fe901 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:23.565561 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-680c730b-db13-424e-af97-cfa9041fe901 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:23.566290 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-680c730b-db13-424e-af97-cfa9041fe901 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:23.566738 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-680c730b-db13-424e-af97-cfa9041fe901 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:23.567156 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-680c730b-db13-424e-af97-cfa9041fe901 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:23.633660 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-680c730b-db13-424e-af97-cfa9041fe901 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:23.641969 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-680c730b-db13-424e-af97-cfa9041fe901 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1139 microversion: 2.1 time: 0.090336 Sep 02 05:25:23.642463 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 213/423] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:23 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1139 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:23.921438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-292e097e-f2d1-455a-b810-e53bece2d3da tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:23.922005 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-292e097e-f2d1-455a-b810-e53bece2d3da tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:23.928715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-292e097e-f2d1-455a-b810-e53bece2d3da tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:23.929209 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-292e097e-f2d1-455a-b810-e53bece2d3da tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:23.929766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-292e097e-f2d1-455a-b810-e53bece2d3da tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:23.930458 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-292e097e-f2d1-455a-b810-e53bece2d3da tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:23.930917 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-292e097e-f2d1-455a-b810-e53bece2d3da tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:23.931339 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-292e097e-f2d1-455a-b810-e53bece2d3da tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:24.075467 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-292e097e-f2d1-455a-b810-e53bece2d3da tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:24.088616 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-292e097e-f2d1-455a-b810-e53bece2d3da tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1521 microversion: 2.1 time: 0.173642 Sep 02 05:25:24.089462 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 211/424] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:23 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:24.254342 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-203848d9-ee4b-4858-9499-6693dd00a27b tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:24.254903 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-203848d9-ee4b-4858-9499-6693dd00a27b tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:24.261468 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-203848d9-ee4b-4858-9499-6693dd00a27b tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:24.261952 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-203848d9-ee4b-4858-9499-6693dd00a27b tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:24.262387 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-203848d9-ee4b-4858-9499-6693dd00a27b tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:24.263069 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-203848d9-ee4b-4858-9499-6693dd00a27b tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:24.263581 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-203848d9-ee4b-4858-9499-6693dd00a27b tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:24.263987 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-203848d9-ee4b-4858-9499-6693dd00a27b tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:24.272255 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f1edb982-42a2-44d1-9e23-691179946c07 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:24.272995 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f1edb982-42a2-44d1-9e23-691179946c07 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:24.281728 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f1edb982-42a2-44d1-9e23-691179946c07 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:24.281728 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f1edb982-42a2-44d1-9e23-691179946c07 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:24.281728 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f1edb982-42a2-44d1-9e23-691179946c07 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:24.282110 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f1edb982-42a2-44d1-9e23-691179946c07 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:24.282472 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f1edb982-42a2-44d1-9e23-691179946c07 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:24.282887 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f1edb982-42a2-44d1-9e23-691179946c07 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:24.363708 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f1edb982-42a2-44d1-9e23-691179946c07 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:24.371862 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f1edb982-42a2-44d1-9e23-691179946c07 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1297 microversion: 2.1 time: 0.103602 Sep 02 05:25:24.372459 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 212/425] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:24 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1297 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:24.420351 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-203848d9-ee4b-4858-9499-6693dd00a27b tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:24.428389 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-203848d9-ee4b-4858-9499-6693dd00a27b tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b" status: 200 len: 1317 microversion: 2.1 time: 0.178063 Sep 02 05:25:24.428945 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 214/426] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:24 2022] GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:24.559691 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-2349befe-50f8-4666-b862-6e6aee959754 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:24.560771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-2349befe-50f8-4666-b862-6e6aee959754 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:24.569742 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2349befe-50f8-4666-b862-6e6aee959754 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:24.570700 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2349befe-50f8-4666-b862-6e6aee959754 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:24.571341 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2349befe-50f8-4666-b862-6e6aee959754 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:24.575164 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2349befe-50f8-4666-b862-6e6aee959754 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:24.576376 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2349befe-50f8-4666-b862-6e6aee959754 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:24.576586 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2349befe-50f8-4666-b862-6e6aee959754 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:24.662585 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-022ebd8a-65b9-4da0-ac35-0dda31513151 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:24.663381 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-022ebd8a-65b9-4da0-ac35-0dda31513151 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:24.669760 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-022ebd8a-65b9-4da0-ac35-0dda31513151 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:24.670241 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-022ebd8a-65b9-4da0-ac35-0dda31513151 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:24.670667 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-022ebd8a-65b9-4da0-ac35-0dda31513151 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:24.671349 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-022ebd8a-65b9-4da0-ac35-0dda31513151 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:24.671792 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-022ebd8a-65b9-4da0-ac35-0dda31513151 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:24.672233 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-022ebd8a-65b9-4da0-ac35-0dda31513151 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:24.750981 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-022ebd8a-65b9-4da0-ac35-0dda31513151 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:24.758422 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-2349befe-50f8-4666-b862-6e6aee959754 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:24.760087 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-022ebd8a-65b9-4da0-ac35-0dda31513151 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1139 microversion: 2.1 time: 0.101453 Sep 02 05:25:24.773228 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 215/427] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:24 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1139 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:24.773788 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-2349befe-50f8-4666-b862-6e6aee959754 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 200 len: 1497 microversion: 2.1 time: 0.211668 Sep 02 05:25:24.773788 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 213/428] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:24 2022] GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 1497 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:25.109884 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-2924236c-2942-42d3-b3aa-217859faae7a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:25.110517 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-2924236c-2942-42d3-b3aa-217859faae7a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:25.122012 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2924236c-2942-42d3-b3aa-217859faae7a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:25.122487 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2924236c-2942-42d3-b3aa-217859faae7a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:25.123020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2924236c-2942-42d3-b3aa-217859faae7a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:25.123617 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2924236c-2942-42d3-b3aa-217859faae7a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:25.124258 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2924236c-2942-42d3-b3aa-217859faae7a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:25.124855 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2924236c-2942-42d3-b3aa-217859faae7a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:25.317861 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-2924236c-2942-42d3-b3aa-217859faae7a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:25.325822 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-2924236c-2942-42d3-b3aa-217859faae7a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1521 microversion: 2.1 time: 0.219923 Sep 02 05:25:25.326395 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 216/429] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:25 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:25.393240 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-eae8f2e8-eb1f-4164-b44f-439e5406f999 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:25.394008 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-eae8f2e8-eb1f-4164-b44f-439e5406f999 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:25.400805 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eae8f2e8-eb1f-4164-b44f-439e5406f999 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:25.401497 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eae8f2e8-eb1f-4164-b44f-439e5406f999 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:25.401935 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eae8f2e8-eb1f-4164-b44f-439e5406f999 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:25.402662 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eae8f2e8-eb1f-4164-b44f-439e5406f999 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:25.403150 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eae8f2e8-eb1f-4164-b44f-439e5406f999 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:25.403663 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eae8f2e8-eb1f-4164-b44f-439e5406f999 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:25.448800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-abeb385d-c14b-461a-80e6-279c50208a78 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:25.449407 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-abeb385d-c14b-461a-80e6-279c50208a78 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:25.458079 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-abeb385d-c14b-461a-80e6-279c50208a78 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:25.458841 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-abeb385d-c14b-461a-80e6-279c50208a78 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:25.459461 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-abeb385d-c14b-461a-80e6-279c50208a78 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:25.460485 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-abeb385d-c14b-461a-80e6-279c50208a78 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:25.461090 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-abeb385d-c14b-461a-80e6-279c50208a78 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:25.461663 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-abeb385d-c14b-461a-80e6-279c50208a78 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:25.482071 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-eae8f2e8-eb1f-4164-b44f-439e5406f999 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:25.494087 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-eae8f2e8-eb1f-4164-b44f-439e5406f999 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1295 microversion: 2.1 time: 0.104705 Sep 02 05:25:25.496400 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 214/430] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:25 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1295 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:25.551946 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-24afb536-58bf-4aa9-aa1a-75b16339255f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:25.552481 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-24afb536-58bf-4aa9-aa1a-75b16339255f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:25.558421 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-24afb536-58bf-4aa9-aa1a-75b16339255f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:25.558893 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-24afb536-58bf-4aa9-aa1a-75b16339255f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:25.559319 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-24afb536-58bf-4aa9-aa1a-75b16339255f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:25.559995 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-24afb536-58bf-4aa9-aa1a-75b16339255f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:25.560491 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-24afb536-58bf-4aa9-aa1a-75b16339255f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:25.560883 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-24afb536-58bf-4aa9-aa1a-75b16339255f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:25.591686 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-24afb536-58bf-4aa9-aa1a-75b16339255f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Going to try to terminate instance {{(pid=120448) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 05:25:25.618757 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-abeb385d-c14b-461a-80e6-279c50208a78 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:25.626653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-abeb385d-c14b-461a-80e6-279c50208a78 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b" status: 200 len: 1317 microversion: 2.1 time: 0.181614 Sep 02 05:25:25.627250 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 217/431] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:25 2022] GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:25.690041 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-24afb536-58bf-4aa9-aa1a-75b16339255f tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 204 len: 0 microversion: 2.1 time: 0.141363 Sep 02 05:25:25.690476 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 215/432] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Sep 2 05:25:25 2022] DELETE /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 02 05:25:25.699499 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-12f2f51e-4ad1-4b6d-9fef-2060e139ce43 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:25.699499 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-12f2f51e-4ad1-4b6d-9fef-2060e139ce43 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:25.705147 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-12f2f51e-4ad1-4b6d-9fef-2060e139ce43 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:25.705630 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-12f2f51e-4ad1-4b6d-9fef-2060e139ce43 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:25.706049 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-12f2f51e-4ad1-4b6d-9fef-2060e139ce43 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:25.706954 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-12f2f51e-4ad1-4b6d-9fef-2060e139ce43 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:25.707390 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-12f2f51e-4ad1-4b6d-9fef-2060e139ce43 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:25.707803 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-12f2f51e-4ad1-4b6d-9fef-2060e139ce43 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:25.781717 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-42e670a3-ecd0-4149-9142-6a9363071a00 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:25.782444 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-42e670a3-ecd0-4149-9142-6a9363071a00 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:25.788746 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-42e670a3-ecd0-4149-9142-6a9363071a00 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:25.789239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-42e670a3-ecd0-4149-9142-6a9363071a00 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:25.789653 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-42e670a3-ecd0-4149-9142-6a9363071a00 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:25.790340 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-42e670a3-ecd0-4149-9142-6a9363071a00 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:25.790788 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-42e670a3-ecd0-4149-9142-6a9363071a00 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:25.791210 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-42e670a3-ecd0-4149-9142-6a9363071a00 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:25.850627 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-12f2f51e-4ad1-4b6d-9fef-2060e139ce43 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:25.858929 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-12f2f51e-4ad1-4b6d-9fef-2060e139ce43 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 200 len: 1503 microversion: 2.1 time: 0.164095 Sep 02 05:25:25.859741 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 218/433] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:25 2022] GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:25.868863 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-42e670a3-ecd0-4149-9142-6a9363071a00 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:25.877013 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-42e670a3-ecd0-4149-9142-6a9363071a00 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1131 microversion: 2.1 time: 0.099475 Sep 02 05:25:25.877588 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 216/434] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:25 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1131 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:26.346223 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-efe8b826-2368-4d0d-be9b-5eaf3f3720e3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:26.346828 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-efe8b826-2368-4d0d-be9b-5eaf3f3720e3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:26.354170 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-efe8b826-2368-4d0d-be9b-5eaf3f3720e3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:26.354170 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-efe8b826-2368-4d0d-be9b-5eaf3f3720e3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:26.354407 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-efe8b826-2368-4d0d-be9b-5eaf3f3720e3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:26.355167 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-efe8b826-2368-4d0d-be9b-5eaf3f3720e3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:26.355599 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-efe8b826-2368-4d0d-be9b-5eaf3f3720e3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:26.356161 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-efe8b826-2368-4d0d-be9b-5eaf3f3720e3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:26.503461 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-efe8b826-2368-4d0d-be9b-5eaf3f3720e3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:26.512172 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-efe8b826-2368-4d0d-be9b-5eaf3f3720e3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1521 microversion: 2.1 time: 0.170296 Sep 02 05:25:26.512847 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 219/435] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:26 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:26.520479 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-b5787698-a3d9-4c79-84d2-99fa468c3aef tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:26.521689 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-b5787698-a3d9-4c79-84d2-99fa468c3aef tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:26.531274 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b5787698-a3d9-4c79-84d2-99fa468c3aef tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:26.531848 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b5787698-a3d9-4c79-84d2-99fa468c3aef tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:26.532307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b5787698-a3d9-4c79-84d2-99fa468c3aef tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:26.533007 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b5787698-a3d9-4c79-84d2-99fa468c3aef tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:26.533457 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b5787698-a3d9-4c79-84d2-99fa468c3aef tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:26.533875 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b5787698-a3d9-4c79-84d2-99fa468c3aef tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:26.650103 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-1ffb24da-86bd-4e6f-89c1-970b051e84cf tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:26.650865 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-1ffb24da-86bd-4e6f-89c1-970b051e84cf tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:26.657602 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1ffb24da-86bd-4e6f-89c1-970b051e84cf tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:26.658154 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1ffb24da-86bd-4e6f-89c1-970b051e84cf tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:26.658652 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1ffb24da-86bd-4e6f-89c1-970b051e84cf tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:26.659793 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1ffb24da-86bd-4e6f-89c1-970b051e84cf tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:26.660600 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1ffb24da-86bd-4e6f-89c1-970b051e84cf tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:26.661148 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1ffb24da-86bd-4e6f-89c1-970b051e84cf tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:26.663123 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-b5787698-a3d9-4c79-84d2-99fa468c3aef tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:26.671126 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-b5787698-a3d9-4c79-84d2-99fa468c3aef tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1363 microversion: 2.1 time: 0.155122 Sep 02 05:25:26.671711 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 217/436] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:26 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:25:26.791588 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1ffb24da-86bd-4e6f-89c1-970b051e84cf tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:26.801448 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-1ffb24da-86bd-4e6f-89c1-970b051e84cf tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b" status: 200 len: 1317 microversion: 2.1 time: 0.155360 Sep 02 05:25:26.802290 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 220/437] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:26 2022] GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:26.884107 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-bd888c65-ec58-46d0-8477-afa03706956d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:26.884838 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-bd888c65-ec58-46d0-8477-afa03706956d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:26.891743 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-bd888c65-ec58-46d0-8477-afa03706956d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:26.892327 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-bd888c65-ec58-46d0-8477-afa03706956d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:26.892835 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-bd888c65-ec58-46d0-8477-afa03706956d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:26.893597 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-bd888c65-ec58-46d0-8477-afa03706956d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:26.894097 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-bd888c65-ec58-46d0-8477-afa03706956d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:26.894565 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-bd888c65-ec58-46d0-8477-afa03706956d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:26.901105 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-f056ae60-e018-4fa8-997f-2c26793d3459 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:26.901675 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-f056ae60-e018-4fa8-997f-2c26793d3459 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:26.908662 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f056ae60-e018-4fa8-997f-2c26793d3459 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:26.909203 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f056ae60-e018-4fa8-997f-2c26793d3459 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:26.909688 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f056ae60-e018-4fa8-997f-2c26793d3459 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:26.910476 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f056ae60-e018-4fa8-997f-2c26793d3459 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:26.910945 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f056ae60-e018-4fa8-997f-2c26793d3459 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:26.911435 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f056ae60-e018-4fa8-997f-2c26793d3459 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:26.996526 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-f056ae60-e018-4fa8-997f-2c26793d3459 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:27.004477 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-f056ae60-e018-4fa8-997f-2c26793d3459 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1131 microversion: 2.1 time: 0.108489 Sep 02 05:25:27.005072 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 221/438] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:26 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1131 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:27.052363 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-bd888c65-ec58-46d0-8477-afa03706956d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:27.060216 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-bd888c65-ec58-46d0-8477-afa03706956d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 200 len: 1503 microversion: 2.1 time: 0.182561 Sep 02 05:25:27.060928 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 218/439] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:26 2022] GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 1503 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:27.533962 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-7d13a512-7926-47f2-a5df-64ce865fd47d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:27.534566 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-7d13a512-7926-47f2-a5df-64ce865fd47d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:27.540485 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7d13a512-7926-47f2-a5df-64ce865fd47d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:27.540961 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7d13a512-7926-47f2-a5df-64ce865fd47d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:27.541384 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7d13a512-7926-47f2-a5df-64ce865fd47d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:27.542061 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7d13a512-7926-47f2-a5df-64ce865fd47d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:27.542507 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7d13a512-7926-47f2-a5df-64ce865fd47d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:27.542923 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7d13a512-7926-47f2-a5df-64ce865fd47d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:27.675197 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-7d13a512-7926-47f2-a5df-64ce865fd47d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:27.683045 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-7d13a512-7926-47f2-a5df-64ce865fd47d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1521 microversion: 2.1 time: 0.152939 Sep 02 05:25:27.683598 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 222/440] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:27 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:27.691228 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-19f44ad9-a099-4147-94ed-0049a7fe692a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:27.691897 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-19f44ad9-a099-4147-94ed-0049a7fe692a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:27.699057 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19f44ad9-a099-4147-94ed-0049a7fe692a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:27.699792 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19f44ad9-a099-4147-94ed-0049a7fe692a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:27.700452 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19f44ad9-a099-4147-94ed-0049a7fe692a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:27.701329 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19f44ad9-a099-4147-94ed-0049a7fe692a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:27.702104 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19f44ad9-a099-4147-94ed-0049a7fe692a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:27.702675 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19f44ad9-a099-4147-94ed-0049a7fe692a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:27.822528 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-243fdc2c-2f5d-45bb-9040-aefd7a40711e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:27.823142 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-243fdc2c-2f5d-45bb-9040-aefd7a40711e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:27.830457 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-243fdc2c-2f5d-45bb-9040-aefd7a40711e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:27.834289 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-19f44ad9-a099-4147-94ed-0049a7fe692a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:27.840164 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-243fdc2c-2f5d-45bb-9040-aefd7a40711e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:27.842402 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-19f44ad9-a099-4147-94ed-0049a7fe692a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1363 microversion: 2.1 time: 0.155088 Sep 02 05:25:27.843050 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-243fdc2c-2f5d-45bb-9040-aefd7a40711e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:27.843784 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-243fdc2c-2f5d-45bb-9040-aefd7a40711e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:27.844584 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 219/441] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:27 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:27.845085 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-243fdc2c-2f5d-45bb-9040-aefd7a40711e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:27.845573 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-243fdc2c-2f5d-45bb-9040-aefd7a40711e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:28.025533 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-a09ee103-9d6f-4a65-a117-330c278cd76d tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:28.025697 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-243fdc2c-2f5d-45bb-9040-aefd7a40711e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:28.026287 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-a09ee103-9d6f-4a65-a117-330c278cd76d tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:28.029269 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:28.037236 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-243fdc2c-2f5d-45bb-9040-aefd7a40711e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b" status: 200 len: 1317 microversion: 2.1 time: 0.217220 Sep 02 05:25:28.037966 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a09ee103-9d6f-4a65-a117-330c278cd76d tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:28.038467 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a09ee103-9d6f-4a65-a117-330c278cd76d tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:28.039039 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a09ee103-9d6f-4a65-a117-330c278cd76d tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:28.039827 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a09ee103-9d6f-4a65-a117-330c278cd76d tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:28.040303 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a09ee103-9d6f-4a65-a117-330c278cd76d tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:28.040725 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a09ee103-9d6f-4a65-a117-330c278cd76d tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:28.049476 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 223/442] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:27 2022] GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:28.081934 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-dd1f10af-2aab-4a5c-9344-459ff3b7431d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:28.082999 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-dd1f10af-2aab-4a5c-9344-459ff3b7431d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:28.089251 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dd1f10af-2aab-4a5c-9344-459ff3b7431d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:28.090055 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dd1f10af-2aab-4a5c-9344-459ff3b7431d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:28.090710 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dd1f10af-2aab-4a5c-9344-459ff3b7431d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:28.091781 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dd1f10af-2aab-4a5c-9344-459ff3b7431d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:28.092483 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dd1f10af-2aab-4a5c-9344-459ff3b7431d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:28.093228 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dd1f10af-2aab-4a5c-9344-459ff3b7431d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:28.106397 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-a09ee103-9d6f-4a65-a117-330c278cd76d tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:28.114557 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-a09ee103-9d6f-4a65-a117-330c278cd76d tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1131 microversion: 2.1 time: 0.093300 Sep 02 05:25:28.115127 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 220/443] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:28 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1131 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:25:28.254200 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-dd1f10af-2aab-4a5c-9344-459ff3b7431d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:28.262862 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-dd1f10af-2aab-4a5c-9344-459ff3b7431d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 200 len: 1503 microversion: 2.1 time: 0.185486 Sep 02 05:25:28.263459 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 224/444] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:28 2022] GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 1503 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:25:28.709167 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-821bddd4-ebb3-4c55-9a72-27fcefa7cd23 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:28.709675 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-821bddd4-ebb3-4c55-9a72-27fcefa7cd23 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:28.728852 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-821bddd4-ebb3-4c55-9a72-27fcefa7cd23 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:28.729380 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-821bddd4-ebb3-4c55-9a72-27fcefa7cd23 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:28.729819 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-821bddd4-ebb3-4c55-9a72-27fcefa7cd23 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:28.730524 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-821bddd4-ebb3-4c55-9a72-27fcefa7cd23 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:28.731185 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-821bddd4-ebb3-4c55-9a72-27fcefa7cd23 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:28.731803 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-821bddd4-ebb3-4c55-9a72-27fcefa7cd23 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:28.864193 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-d634b9dd-af2c-4497-9dc5-16ef3ca0072c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:28.865506 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-d634b9dd-af2c-4497-9dc5-16ef3ca0072c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:28.872979 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d634b9dd-af2c-4497-9dc5-16ef3ca0072c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:28.873864 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d634b9dd-af2c-4497-9dc5-16ef3ca0072c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:28.874517 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d634b9dd-af2c-4497-9dc5-16ef3ca0072c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:28.875480 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d634b9dd-af2c-4497-9dc5-16ef3ca0072c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:28.876312 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d634b9dd-af2c-4497-9dc5-16ef3ca0072c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:28.877096 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d634b9dd-af2c-4497-9dc5-16ef3ca0072c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:28.902498 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=100 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:28.906271 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-821bddd4-ebb3-4c55-9a72-27fcefa7cd23 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:28.920045 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-821bddd4-ebb3-4c55-9a72-27fcefa7cd23 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1521 microversion: 2.1 time: 0.214579 Sep 02 05:25:28.932563 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 221/445] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:28 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:28.940486 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-a3fc38d2-6a3a-46f8-a39f-01bdf2851b67 req-d316ddb3-38a3-48b4-bb52-509e26965e0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "387fc985-a99f-4805-ab55-641d3fe7cc27", "tag": "fb24bf1a-8f67-4eb6-b5bb-47d994b3c852"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:25:28.955112 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-a3fc38d2-6a3a-46f8-a39f-01bdf2851b67 req-d316ddb3-38a3-48b4-bb52-509e26965e0b service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:28.957304 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-a3fc38d2-6a3a-46f8-a39f-01bdf2851b67 req-d316ddb3-38a3-48b4-bb52-509e26965e0b service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:28.958218 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-a3fc38d2-6a3a-46f8-a39f-01bdf2851b67 req-d316ddb3-38a3-48b4-bb52-509e26965e0b service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:28.976645 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-a3fc38d2-6a3a-46f8-a39f-01bdf2851b67 req-d316ddb3-38a3-48b4-bb52-509e26965e0b service nova] Creating event network-changed:fb24bf1a-8f67-4eb6-b5bb-47d994b3c852 for instance 387fc985-a99f-4805-ab55-641d3fe7cc27 on hv-cinder-85391 Sep 02 05:25:28.987086 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-a3fc38d2-6a3a-46f8-a39f-01bdf2851b67 req-d316ddb3-38a3-48b4-bb52-509e26965e0b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052438 Sep 02 05:25:28.989199 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 222/446] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:25:29.055698 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-d634b9dd-af2c-4497-9dc5-16ef3ca0072c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:29.059986 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-2aa2c4e9-2f3f-47ec-8047-e477293675f7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:29.061071 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-2aa2c4e9-2f3f-47ec-8047-e477293675f7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:29.068261 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-d634b9dd-af2c-4497-9dc5-16ef3ca0072c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1363 microversion: 2.1 time: 0.207356 Sep 02 05:25:29.068588 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 225/447] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:28 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:29.074676 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2aa2c4e9-2f3f-47ec-8047-e477293675f7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:29.075379 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2aa2c4e9-2f3f-47ec-8047-e477293675f7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:29.075936 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2aa2c4e9-2f3f-47ec-8047-e477293675f7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:29.077022 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2aa2c4e9-2f3f-47ec-8047-e477293675f7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:29.077645 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2aa2c4e9-2f3f-47ec-8047-e477293675f7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:29.078217 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2aa2c4e9-2f3f-47ec-8047-e477293675f7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:29.136277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-4d6e5b31-1e1c-42d8-9cef-4e823ba37309 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:29.137208 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-4d6e5b31-1e1c-42d8-9cef-4e823ba37309 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:29.143634 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4d6e5b31-1e1c-42d8-9cef-4e823ba37309 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:29.144430 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4d6e5b31-1e1c-42d8-9cef-4e823ba37309 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:29.145101 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4d6e5b31-1e1c-42d8-9cef-4e823ba37309 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:29.146021 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4d6e5b31-1e1c-42d8-9cef-4e823ba37309 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:29.146681 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4d6e5b31-1e1c-42d8-9cef-4e823ba37309 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:29.147328 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4d6e5b31-1e1c-42d8-9cef-4e823ba37309 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:29.231299 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-4d6e5b31-1e1c-42d8-9cef-4e823ba37309 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:29.239381 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-4d6e5b31-1e1c-42d8-9cef-4e823ba37309 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1187 microversion: 2.1 time: 0.107094 Sep 02 05:25:29.239952 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 226/448] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:29 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1187 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:25:29.248273 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-2aa2c4e9-2f3f-47ec-8047-e477293675f7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:29.261860 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-2aa2c4e9-2f3f-47ec-8047-e477293675f7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b" status: 200 len: 1505 microversion: 2.1 time: 0.208719 Sep 02 05:25:29.262443 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 223/449] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:29 2022] GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b => generated 1505 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:29.283628 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-f8ccc70b-dea3-4f18-b83f-e9f3558c0efc tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:29.284282 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-f8ccc70b-dea3-4f18-b83f-e9f3558c0efc tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:29.290607 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f8ccc70b-dea3-4f18-b83f-e9f3558c0efc tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:29.291095 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f8ccc70b-dea3-4f18-b83f-e9f3558c0efc tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:29.291527 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f8ccc70b-dea3-4f18-b83f-e9f3558c0efc tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:29.292537 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f8ccc70b-dea3-4f18-b83f-e9f3558c0efc tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:29.292992 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f8ccc70b-dea3-4f18-b83f-e9f3558c0efc tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:29.293414 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f8ccc70b-dea3-4f18-b83f-e9f3558c0efc tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:29.362030 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-f8ccc70b-dea3-4f18-b83f-e9f3558c0efc tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:29.370162 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-f8ccc70b-dea3-4f18-b83f-e9f3558c0efc tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 200 len: 1461 microversion: 2.1 time: 0.090280 Sep 02 05:25:29.370883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 227/450] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:29 2022] GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 1461 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:29.945001 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d12226ea-0f17-41b2-954e-23c9bd6df0bc tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:29.946811 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-d12226ea-0f17-41b2-954e-23c9bd6df0bc tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:29.953548 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d12226ea-0f17-41b2-954e-23c9bd6df0bc tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:29.954036 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d12226ea-0f17-41b2-954e-23c9bd6df0bc tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:29.954475 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d12226ea-0f17-41b2-954e-23c9bd6df0bc tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:29.955189 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d12226ea-0f17-41b2-954e-23c9bd6df0bc tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:29.955638 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d12226ea-0f17-41b2-954e-23c9bd6df0bc tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:29.956058 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d12226ea-0f17-41b2-954e-23c9bd6df0bc tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:30.094483 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-694b7c07-e517-4d63-81d9-f96f6918bf7d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:30.095726 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-694b7c07-e517-4d63-81d9-f96f6918bf7d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:30.109129 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-694b7c07-e517-4d63-81d9-f96f6918bf7d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:30.109620 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-694b7c07-e517-4d63-81d9-f96f6918bf7d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:30.110055 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-694b7c07-e517-4d63-81d9-f96f6918bf7d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:30.110752 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-694b7c07-e517-4d63-81d9-f96f6918bf7d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:30.111201 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-694b7c07-e517-4d63-81d9-f96f6918bf7d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:30.111614 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-694b7c07-e517-4d63-81d9-f96f6918bf7d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:30.128175 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d12226ea-0f17-41b2-954e-23c9bd6df0bc tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:30.137524 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-d12226ea-0f17-41b2-954e-23c9bd6df0bc tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1521 microversion: 2.1 time: 0.197266 Sep 02 05:25:30.138112 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 224/451] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:29 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:30.262241 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-eca7350d-44ce-455e-9c6d-b51cf4230210 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:30.262844 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-eca7350d-44ce-455e-9c6d-b51cf4230210 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:30.273752 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eca7350d-44ce-455e-9c6d-b51cf4230210 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:30.274341 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eca7350d-44ce-455e-9c6d-b51cf4230210 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:30.274801 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eca7350d-44ce-455e-9c6d-b51cf4230210 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:30.275506 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eca7350d-44ce-455e-9c6d-b51cf4230210 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:30.275952 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eca7350d-44ce-455e-9c6d-b51cf4230210 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:30.276393 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eca7350d-44ce-455e-9c6d-b51cf4230210 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:30.295066 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-694b7c07-e517-4d63-81d9-f96f6918bf7d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:30.305364 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-694b7c07-e517-4d63-81d9-f96f6918bf7d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1363 microversion: 2.1 time: 0.215794 Sep 02 05:25:30.306547 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 228/452] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:30 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:30.353692 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-eca7350d-44ce-455e-9c6d-b51cf4230210 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:30.361437 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-eca7350d-44ce-455e-9c6d-b51cf4230210 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1187 microversion: 2.1 time: 0.105361 Sep 02 05:25:30.362009 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 225/453] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:30 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1187 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:30.392322 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-c6f0985b-687c-4dcb-ac7c-f5776e59906e tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:30.393289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-c6f0985b-687c-4dcb-ac7c-f5776e59906e tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:30.400162 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c6f0985b-687c-4dcb-ac7c-f5776e59906e tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:30.400655 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c6f0985b-687c-4dcb-ac7c-f5776e59906e tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:30.401081 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c6f0985b-687c-4dcb-ac7c-f5776e59906e tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:30.401780 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c6f0985b-687c-4dcb-ac7c-f5776e59906e tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:30.402224 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c6f0985b-687c-4dcb-ac7c-f5776e59906e tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:30.402648 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c6f0985b-687c-4dcb-ac7c-f5776e59906e tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:30.433470 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c6f0985b-687c-4dcb-ac7c-f5776e59906e tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:30.433993 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c6f0985b-687c-4dcb-ac7c-f5776e59906e tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:30.434439 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c6f0985b-687c-4dcb-ac7c-f5776e59906e tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:30.434872 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.objects.instance [None req-c6f0985b-687c-4dcb-ac7c-f5776e59906e tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lazy-loading 'fault' on Instance uuid ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de {{(pid=120449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:25:30.482223 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-c6f0985b-687c-4dcb-ac7c-f5776e59906e tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:30.493992 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-c6f0985b-687c-4dcb-ac7c-f5776e59906e tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 200 len: 1304 microversion: 2.1 time: 0.106688 Sep 02 05:25:30.494488 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 229/454] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:30 2022] GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:31.008743 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-cdf2f823-a850-40e4-9800-4f2addbd055a req-6cb97dcf-388d-469c-8e98-56836c6babb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de", "name": "network-vif-deleted", "tag": "c2607880-31ef-4eba-b1cd-89f6200c26a5"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:25:31.018900 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-cdf2f823-a850-40e4-9800-4f2addbd055a req-6cb97dcf-388d-469c-8e98-56836c6babb8 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:31.019374 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-cdf2f823-a850-40e4-9800-4f2addbd055a req-6cb97dcf-388d-469c-8e98-56836c6babb8 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:31.019798 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-cdf2f823-a850-40e4-9800-4f2addbd055a req-6cb97dcf-388d-469c-8e98-56836c6babb8 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:31.030865 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-cdf2f823-a850-40e4-9800-4f2addbd055a req-6cb97dcf-388d-469c-8e98-56836c6babb8 service nova] Creating event network-vif-deleted:c2607880-31ef-4eba-b1cd-89f6200c26a5 for instance ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de on hv-cinder-85391 Sep 02 05:25:31.035783 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-cdf2f823-a850-40e4-9800-4f2addbd055a req-6cb97dcf-388d-469c-8e98-56836c6babb8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030756 Sep 02 05:25:31.036562 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 226/455] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:25:31.163792 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-8eaf4299-6ed5-44e6-88a7-d43437ba0c8a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:31.165130 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-8eaf4299-6ed5-44e6-88a7-d43437ba0c8a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:31.177733 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8eaf4299-6ed5-44e6-88a7-d43437ba0c8a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:31.178534 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8eaf4299-6ed5-44e6-88a7-d43437ba0c8a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:31.179474 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8eaf4299-6ed5-44e6-88a7-d43437ba0c8a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:31.180853 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8eaf4299-6ed5-44e6-88a7-d43437ba0c8a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:31.181311 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8eaf4299-6ed5-44e6-88a7-d43437ba0c8a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:31.181704 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8eaf4299-6ed5-44e6-88a7-d43437ba0c8a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:31.325819 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell0:SELECT=4 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:31.326705 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell0:SELECT=5 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:31.330590 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-8eaf4299-6ed5-44e6-88a7-d43437ba0c8a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:31.330981 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-18175d81-f1ca-4c68-9779-c60a7d99ad91 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:31.331790 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-18175d81-f1ca-4c68-9779-c60a7d99ad91 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:31.338575 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-8eaf4299-6ed5-44e6-88a7-d43437ba0c8a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1521 microversion: 2.1 time: 0.181188 Sep 02 05:25:31.338909 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-18175d81-f1ca-4c68-9779-c60a7d99ad91 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:31.339136 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 230/456] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:31 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:31.339515 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-18175d81-f1ca-4c68-9779-c60a7d99ad91 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:31.340096 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-18175d81-f1ca-4c68-9779-c60a7d99ad91 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:31.340869 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-18175d81-f1ca-4c68-9779-c60a7d99ad91 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:31.341314 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-18175d81-f1ca-4c68-9779-c60a7d99ad91 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:31.341729 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-18175d81-f1ca-4c68-9779-c60a7d99ad91 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:31.345812 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:31.382218 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-57d69fb3-7fc7-45cd-9c78-96bfe00e0d25 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:31.382827 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-57d69fb3-7fc7-45cd-9c78-96bfe00e0d25 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:31.389076 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-57d69fb3-7fc7-45cd-9c78-96bfe00e0d25 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:31.389565 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-57d69fb3-7fc7-45cd-9c78-96bfe00e0d25 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:31.390002 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-57d69fb3-7fc7-45cd-9c78-96bfe00e0d25 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:31.390695 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-57d69fb3-7fc7-45cd-9c78-96bfe00e0d25 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:31.391146 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-57d69fb3-7fc7-45cd-9c78-96bfe00e0d25 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:31.391566 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-57d69fb3-7fc7-45cd-9c78-96bfe00e0d25 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:31.434952 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell0:SELECT=4 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:31.466441 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-57d69fb3-7fc7-45cd-9c78-96bfe00e0d25 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:31.474127 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-57d69fb3-7fc7-45cd-9c78-96bfe00e0d25 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1195 microversion: 2.1 time: 0.095703 Sep 02 05:25:31.474701 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 231/457] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:31 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1195 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:31.497392 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-18175d81-f1ca-4c68-9779-c60a7d99ad91 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:31.508018 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-18175d81-f1ca-4c68-9779-c60a7d99ad91 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1363 microversion: 2.1 time: 0.183020 Sep 02 05:25:31.509136 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 227/458] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:31 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:31.521728 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-3c1f574f-2c3a-4e70-948a-c0da061ec07d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:31.522258 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-3c1f574f-2c3a-4e70-948a-c0da061ec07d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:31.528830 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3c1f574f-2c3a-4e70-948a-c0da061ec07d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:31.529350 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3c1f574f-2c3a-4e70-948a-c0da061ec07d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:31.529806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3c1f574f-2c3a-4e70-948a-c0da061ec07d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:31.530688 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3c1f574f-2c3a-4e70-948a-c0da061ec07d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:31.531213 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3c1f574f-2c3a-4e70-948a-c0da061ec07d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:31.531675 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3c1f574f-2c3a-4e70-948a-c0da061ec07d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:31.562721 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3c1f574f-2c3a-4e70-948a-c0da061ec07d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:31.563240 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3c1f574f-2c3a-4e70-948a-c0da061ec07d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:31.563748 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3c1f574f-2c3a-4e70-948a-c0da061ec07d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:31.564226 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.objects.instance [None req-3c1f574f-2c3a-4e70-948a-c0da061ec07d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lazy-loading 'fault' on Instance uuid ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de {{(pid=120449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:25:31.617374 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-3c1f574f-2c3a-4e70-948a-c0da061ec07d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:31.625866 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-3c1f574f-2c3a-4e70-948a-c0da061ec07d tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 200 len: 1304 microversion: 2.1 time: 0.108191 Sep 02 05:25:31.626450 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 232/459] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:31 2022] GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:32.364390 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-2131f592-3efc-4ad9-a882-dce91d25811e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:32.365318 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-2131f592-3efc-4ad9-a882-dce91d25811e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:32.376986 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2131f592-3efc-4ad9-a882-dce91d25811e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:32.377881 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2131f592-3efc-4ad9-a882-dce91d25811e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:32.378640 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2131f592-3efc-4ad9-a882-dce91d25811e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:32.379979 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2131f592-3efc-4ad9-a882-dce91d25811e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:32.380812 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2131f592-3efc-4ad9-a882-dce91d25811e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:32.381571 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2131f592-3efc-4ad9-a882-dce91d25811e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:32.495304 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-76f92924-2f7e-4ac8-81db-f6036da143b4 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:32.495908 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-76f92924-2f7e-4ac8-81db-f6036da143b4 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:32.502347 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-76f92924-2f7e-4ac8-81db-f6036da143b4 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:32.502828 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-76f92924-2f7e-4ac8-81db-f6036da143b4 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:32.503257 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-76f92924-2f7e-4ac8-81db-f6036da143b4 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:32.503941 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-76f92924-2f7e-4ac8-81db-f6036da143b4 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:32.504415 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-76f92924-2f7e-4ac8-81db-f6036da143b4 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:32.504834 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-76f92924-2f7e-4ac8-81db-f6036da143b4 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:32.519238 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-2131f592-3efc-4ad9-a882-dce91d25811e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:32.527912 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-2131f592-3efc-4ad9-a882-dce91d25811e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1521 microversion: 2.1 time: 0.169876 Sep 02 05:25:32.528561 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 228/460] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:32 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:32.532982 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-a6111570-1ec2-45b3-b422-aac8b3334e83 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:32.533594 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-a6111570-1ec2-45b3-b422-aac8b3334e83 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:32.539522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a6111570-1ec2-45b3-b422-aac8b3334e83 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:32.540007 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a6111570-1ec2-45b3-b422-aac8b3334e83 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:32.540480 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a6111570-1ec2-45b3-b422-aac8b3334e83 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:32.541177 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a6111570-1ec2-45b3-b422-aac8b3334e83 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:32.541631 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a6111570-1ec2-45b3-b422-aac8b3334e83 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:32.542057 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a6111570-1ec2-45b3-b422-aac8b3334e83 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:32.570515 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-76f92924-2f7e-4ac8-81db-f6036da143b4 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:32.578834 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-76f92924-2f7e-4ac8-81db-f6036da143b4 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1195 microversion: 2.1 time: 0.087628 Sep 02 05:25:32.579408 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 233/461] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:32 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1195 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:32.657250 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-b381ead0-5962-4783-a5d9-d0e66e3f96f9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:32.657863 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-b381ead0-5962-4783-a5d9-d0e66e3f96f9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:32.664281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b381ead0-5962-4783-a5d9-d0e66e3f96f9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:32.664767 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b381ead0-5962-4783-a5d9-d0e66e3f96f9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:32.665258 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b381ead0-5962-4783-a5d9-d0e66e3f96f9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:32.665936 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b381ead0-5962-4783-a5d9-d0e66e3f96f9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:32.666384 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b381ead0-5962-4783-a5d9-d0e66e3f96f9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:32.666802 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b381ead0-5962-4783-a5d9-d0e66e3f96f9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:32.674225 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-a6111570-1ec2-45b3-b422-aac8b3334e83 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:32.682083 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-a6111570-1ec2-45b3-b422-aac8b3334e83 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1363 microversion: 2.1 time: 0.152579 Sep 02 05:25:32.682874 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 229/462] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:32 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:32.697719 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b381ead0-5962-4783-a5d9-d0e66e3f96f9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:32.698202 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b381ead0-5962-4783-a5d9-d0e66e3f96f9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:32.698630 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b381ead0-5962-4783-a5d9-d0e66e3f96f9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:32.699071 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.objects.instance [None req-b381ead0-5962-4783-a5d9-d0e66e3f96f9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lazy-loading 'fault' on Instance uuid ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de {{(pid=120449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:25:32.739219 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-b381ead0-5962-4783-a5d9-d0e66e3f96f9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:32.749053 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-b381ead0-5962-4783-a5d9-d0e66e3f96f9 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 200 len: 1304 microversion: 2.1 time: 0.101121 Sep 02 05:25:32.749934 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 234/463] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:32 2022] GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:33.548889 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-4ee0dbce-1cac-403a-9020-c36a8230039d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:33.549498 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-4ee0dbce-1cac-403a-9020-c36a8230039d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:33.556264 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4ee0dbce-1cac-403a-9020-c36a8230039d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:33.556756 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4ee0dbce-1cac-403a-9020-c36a8230039d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:33.557181 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4ee0dbce-1cac-403a-9020-c36a8230039d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:33.557866 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4ee0dbce-1cac-403a-9020-c36a8230039d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:33.558314 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4ee0dbce-1cac-403a-9020-c36a8230039d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:33.558742 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4ee0dbce-1cac-403a-9020-c36a8230039d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:33.599872 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ba2724c8-2205-4e30-9d65-6a1e92189c12 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:33.600489 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-ba2724c8-2205-4e30-9d65-6a1e92189c12 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:33.607672 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ba2724c8-2205-4e30-9d65-6a1e92189c12 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:33.608503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ba2724c8-2205-4e30-9d65-6a1e92189c12 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:33.608921 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ba2724c8-2205-4e30-9d65-6a1e92189c12 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:33.609677 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ba2724c8-2205-4e30-9d65-6a1e92189c12 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:33.610125 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ba2724c8-2205-4e30-9d65-6a1e92189c12 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:33.610549 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ba2724c8-2205-4e30-9d65-6a1e92189c12 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:33.695679 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ba2724c8-2205-4e30-9d65-6a1e92189c12 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:33.705412 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-ba2724c8-2205-4e30-9d65-6a1e92189c12 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1195 microversion: 2.1 time: 0.109598 Sep 02 05:25:33.706034 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 235/464] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:33 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1195 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:33.710799 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-736ff65d-0700-4afe-996f-86171daf0551 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:33.711365 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-736ff65d-0700-4afe-996f-86171daf0551 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:33.717882 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-736ff65d-0700-4afe-996f-86171daf0551 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:33.718362 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-736ff65d-0700-4afe-996f-86171daf0551 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:33.718784 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-736ff65d-0700-4afe-996f-86171daf0551 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:33.719466 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-736ff65d-0700-4afe-996f-86171daf0551 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:33.719909 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-736ff65d-0700-4afe-996f-86171daf0551 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:33.720401 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-736ff65d-0700-4afe-996f-86171daf0551 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:33.730841 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-4ee0dbce-1cac-403a-9020-c36a8230039d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:33.740404 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-4ee0dbce-1cac-403a-9020-c36a8230039d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1521 microversion: 2.1 time: 0.194780 Sep 02 05:25:33.740855 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 230/465] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:33 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:33.769735 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-9335aecf-d63a-4f41-a584-c7db3d090050 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:33.770245 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-9335aecf-d63a-4f41-a584-c7db3d090050 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:33.776261 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9335aecf-d63a-4f41-a584-c7db3d090050 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:33.776714 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9335aecf-d63a-4f41-a584-c7db3d090050 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:33.777171 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9335aecf-d63a-4f41-a584-c7db3d090050 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:33.777854 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9335aecf-d63a-4f41-a584-c7db3d090050 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:33.778301 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9335aecf-d63a-4f41-a584-c7db3d090050 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:33.778719 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9335aecf-d63a-4f41-a584-c7db3d090050 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:33.811222 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9335aecf-d63a-4f41-a584-c7db3d090050 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:33.811705 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9335aecf-d63a-4f41-a584-c7db3d090050 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:33.812142 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9335aecf-d63a-4f41-a584-c7db3d090050 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:33.812598 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.objects.instance [None req-9335aecf-d63a-4f41-a584-c7db3d090050 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lazy-loading 'fault' on Instance uuid ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de {{(pid=120448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:25:33.858759 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-9335aecf-d63a-4f41-a584-c7db3d090050 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:33.866476 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-9335aecf-d63a-4f41-a584-c7db3d090050 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 200 len: 1304 microversion: 2.1 time: 0.100674 Sep 02 05:25:33.867233 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 231/466] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:33 2022] GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:33.881717 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-736ff65d-0700-4afe-996f-86171daf0551 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:33.889830 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-736ff65d-0700-4afe-996f-86171daf0551 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1363 microversion: 2.1 time: 0.182865 Sep 02 05:25:33.890395 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 236/467] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:33 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:34.727302 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-07b99c7c-621e-43b4-a1b4-3ab6b96df7db tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:34.728096 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-07b99c7c-621e-43b4-a1b4-3ab6b96df7db tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:34.734867 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-07b99c7c-621e-43b4-a1b4-3ab6b96df7db tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:34.735366 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-07b99c7c-621e-43b4-a1b4-3ab6b96df7db tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:34.735801 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-07b99c7c-621e-43b4-a1b4-3ab6b96df7db tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:34.736541 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-07b99c7c-621e-43b4-a1b4-3ab6b96df7db tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:34.736997 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-07b99c7c-621e-43b4-a1b4-3ab6b96df7db tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:34.737423 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-07b99c7c-621e-43b4-a1b4-3ab6b96df7db tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:34.761004 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-eb59e1bd-511c-4224-9a3b-df0d098fa57a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:34.761643 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-eb59e1bd-511c-4224-9a3b-df0d098fa57a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:34.768402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-eb59e1bd-511c-4224-9a3b-df0d098fa57a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:34.768891 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-eb59e1bd-511c-4224-9a3b-df0d098fa57a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:34.769330 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-eb59e1bd-511c-4224-9a3b-df0d098fa57a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:34.770025 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-eb59e1bd-511c-4224-9a3b-df0d098fa57a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:34.770480 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-eb59e1bd-511c-4224-9a3b-df0d098fa57a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:34.770904 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-eb59e1bd-511c-4224-9a3b-df0d098fa57a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:34.799472 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-07b99c7c-621e-43b4-a1b4-3ab6b96df7db tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:34.807504 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-07b99c7c-621e-43b4-a1b4-3ab6b96df7db tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1205 microversion: 2.1 time: 0.084908 Sep 02 05:25:34.808079 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 232/468] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:34 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1205 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:25:34.886996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-cc1526f2-87ad-4b3f-ba66-08424df3e28c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:34.887623 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-cc1526f2-87ad-4b3f-ba66-08424df3e28c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:34.894674 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cc1526f2-87ad-4b3f-ba66-08424df3e28c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:34.895147 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cc1526f2-87ad-4b3f-ba66-08424df3e28c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:34.895603 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cc1526f2-87ad-4b3f-ba66-08424df3e28c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:34.896346 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cc1526f2-87ad-4b3f-ba66-08424df3e28c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:34.896800 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cc1526f2-87ad-4b3f-ba66-08424df3e28c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:34.897195 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cc1526f2-87ad-4b3f-ba66-08424df3e28c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:34.906885 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-eb59e1bd-511c-4224-9a3b-df0d098fa57a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:34.915284 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-eb59e1bd-511c-4224-9a3b-df0d098fa57a tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1521 microversion: 2.1 time: 0.158083 Sep 02 05:25:34.915857 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 237/469] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:34 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:34.920247 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-4ece2457-eab2-4f58-a439-96f563c37396 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:34.920921 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-4ece2457-eab2-4f58-a439-96f563c37396 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:34.926905 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4ece2457-eab2-4f58-a439-96f563c37396 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:34.927393 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4ece2457-eab2-4f58-a439-96f563c37396 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:34.927830 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4ece2457-eab2-4f58-a439-96f563c37396 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:34.928540 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4ece2457-eab2-4f58-a439-96f563c37396 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:34.928997 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4ece2457-eab2-4f58-a439-96f563c37396 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:34.929425 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4ece2457-eab2-4f58-a439-96f563c37396 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:34.929683 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cc1526f2-87ad-4b3f-ba66-08424df3e28c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:34.930161 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cc1526f2-87ad-4b3f-ba66-08424df3e28c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:34.930658 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cc1526f2-87ad-4b3f-ba66-08424df3e28c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:34.931089 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.objects.instance [None req-cc1526f2-87ad-4b3f-ba66-08424df3e28c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lazy-loading 'fault' on Instance uuid ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de {{(pid=120448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:25:34.972909 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-cc1526f2-87ad-4b3f-ba66-08424df3e28c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a007e2f923f142f8a82e8a976a8e660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a293b863c45bfa9642ec75a94b824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:34.981289 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-cc1526f2-87ad-4b3f-ba66-08424df3e28c tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 200 len: 1304 microversion: 2.1 time: 0.098035 Sep 02 05:25:34.982072 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 233/470] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:34 2022] GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:35.071623 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-4ece2457-eab2-4f58-a439-96f563c37396 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:35.079335 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-4ece2457-eab2-4f58-a439-96f563c37396 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1363 microversion: 2.1 time: 0.162537 Sep 02 05:25:35.079902 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 238/471] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:34 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:35.828674 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f9b0e246-170b-41c4-859b-a79a16308018 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:35.829280 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f9b0e246-170b-41c4-859b-a79a16308018 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:35.838333 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f9b0e246-170b-41c4-859b-a79a16308018 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:35.838812 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f9b0e246-170b-41c4-859b-a79a16308018 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:35.843201 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f9b0e246-170b-41c4-859b-a79a16308018 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:35.843995 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f9b0e246-170b-41c4-859b-a79a16308018 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:35.844498 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f9b0e246-170b-41c4-859b-a79a16308018 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:35.848529 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f9b0e246-170b-41c4-859b-a79a16308018 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:35.945369 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-12929b21-4a8d-40ca-b294-444c717ec348 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:35.949667 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-12929b21-4a8d-40ca-b294-444c717ec348 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:35.963559 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-12929b21-4a8d-40ca-b294-444c717ec348 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:35.964346 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-12929b21-4a8d-40ca-b294-444c717ec348 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:35.965013 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-12929b21-4a8d-40ca-b294-444c717ec348 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:35.966012 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-12929b21-4a8d-40ca-b294-444c717ec348 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:35.966713 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-12929b21-4a8d-40ca-b294-444c717ec348 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:35.967330 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-12929b21-4a8d-40ca-b294-444c717ec348 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:36.148444 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f9b0e246-170b-41c4-859b-a79a16308018 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:36.159276 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f9b0e246-170b-41c4-859b-a79a16308018 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1205 microversion: 2.1 time: 0.334047 Sep 02 05:25:36.160263 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 234/472] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:35 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1205 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:36.166162 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d15621dd-70c1-4bc6-803f-117ee625a358 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:36.166915 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-d15621dd-70c1-4bc6-803f-117ee625a358 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] [instance: ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:36.173146 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d15621dd-70c1-4bc6-803f-117ee625a358 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:36.173636 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d15621dd-70c1-4bc6-803f-117ee625a358 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:36.174074 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d15621dd-70c1-4bc6-803f-117ee625a358 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:36.174763 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d15621dd-70c1-4bc6-803f-117ee625a358 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:36.175383 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d15621dd-70c1-4bc6-803f-117ee625a358 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:36.175816 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d15621dd-70c1-4bc6-803f-117ee625a358 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:36.190005 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.wsgi [None req-d15621dd-70c1-4bc6-803f-117ee625a358 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] HTTP exception thrown: Instance ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de could not be found. Sep 02 05:25:36.191766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d15621dd-70c1-4bc6-803f-117ee625a358 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Request method failure captured: Sep 02 05:25:36.191766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: request: GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de HTTP/1.1 Sep 02 05:25:36.191766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept: application/json Sep 02 05:25:36.191766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept-Encoding: identity Sep 02 05:25:36.191766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Connection: close Sep 02 05:25:36.191766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Length: 0 Sep 02 05:25:36.191766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Type: application/json Sep 02 05:25:36.191766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Host: 10.222.0.30 Sep 02 05:25:36.191766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Openstack-System-Scope: None Sep 02 05:25:36.191766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: User-Agent: python-urllib3/1.26.12 Sep 02 05:25:36.191766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Auth-Token: gAAAAABjEZNsgTFaVPNC9qEsb35x5XiTMWuigEaHYSQiDQ7JgB5n6dsdK3LNPJS5_LdYdpVLn1qR3LKwIxqJbADer2UBsuk7O7N0Q92KOlo7pYjgLZpxncQbW9zlTJivp0blflE1ruG7H0gVeoAcWnhedwnC_wyGrAosdHRNgV52mY3Sce3oVZE Sep 02 05:25:36.191766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Id: None Sep 02 05:25:36.191766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Name: None Sep 02 05:25:36.191766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Identity-Status: Confirmed Sep 02 05:25:36.191766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Is-Admin-Project: True Sep 02 05:25:36.191766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Id: default Sep 02 05:25:36.191766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Name: Default Sep 02 05:25:36.191766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Id: 179a293b863c45bfa9642ec75a94b824 Sep 02 05:25:36.191766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Name: tempest-VolumesActionsTest-891452206 Sep 02 05:25:36.191766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Role: member,reader Sep 02 05:25:36.191766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Roles: member,reader Sep 02 05:25:36.193328 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_179a293b863c45bfa9642ec75a94b824"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/179a293b863c45bfa9642ec75a94b824"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/179a293b863c45bfa9642ec75a94b824"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/179a293b863c45bfa9642ec75a94b824"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:25:36.193328 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant: tempest-VolumesActionsTest-891452206 Sep 02 05:25:36.193328 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Id: 179a293b863c45bfa9642ec75a94b824 Sep 02 05:25:36.193328 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Name: tempest-VolumesActionsTest-891452206 Sep 02 05:25:36.193328 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User: tempest-VolumesActionsTest-891452206-project Sep 02 05:25:36.193328 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Id: default Sep 02 05:25:36.193328 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Name: Default Sep 02 05:25:36.193328 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Id: a007e2f923f142f8a82e8a976a8e660f Sep 02 05:25:36.193328 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Name: tempest-VolumesActionsTest-891452206-project Sep 02 05:25:36.193328 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: method: > Sep 02 05:25:36.193328 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: exception: Instance ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de could not be found. Sep 02 05:25:36.193328 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: action_args: {'id': 'ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de'} Sep 02 05:25:36.194946 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:25:36.194946 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:25:36.194946 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:25:36.194946 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:25:36.194946 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:25:36.194946 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:25:36.194946 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:25:36.194946 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:25:36.194946 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:25:36.194946 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:25:36.194946 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de could not be found. Sep 02 05:25:36.194946 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:25:36.194946 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:25:36.194946 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:25:36.194946 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:25:36.194946 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:25:36.194946 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:25:36.194946 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:25:36.194946 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:25:36.194946 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:25:36.196525 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:25:36.196525 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:25:36.196525 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:25:36.196525 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:25:36.196525 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:25:36.196525 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:25:36.196525 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:25:36.196525 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de could not be found. Sep 02 05:25:36.196525 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:25:36.196525 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:25:36.196525 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:25:36.196525 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:25:36.196525 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:25:36.196525 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:25:36.196525 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:25:36.196525 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:25:36.196525 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de could not be found. Sep 02 05:25:36.196525 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:25:36.197595 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d15621dd-70c1-4bc6-803f-117ee625a358 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] Returning 404 to user: Instance ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de could not be found. {{(pid=120448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:25:36.197595 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-d15621dd-70c1-4bc6-803f-117ee625a358 tempest-VolumesActionsTest-891452206 tempest-VolumesActionsTest-891452206-project] 10.222.0.30 "GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de" status: 404 len: 111 microversion: 2.1 time: 0.030976 Sep 02 05:25:36.197595 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 235/473] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:36 2022] GET /compute/v2.1/servers/ac5f6ef1-a4a4-4228-b8ee-ab5e1199d0de => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:25:36.200319 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-ba3e3a21-7324-453a-8fe7-54639edfa54e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:36.201464 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-ba3e3a21-7324-453a-8fe7-54639edfa54e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:36.208327 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ba3e3a21-7324-453a-8fe7-54639edfa54e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:36.208996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ba3e3a21-7324-453a-8fe7-54639edfa54e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:36.209836 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ba3e3a21-7324-453a-8fe7-54639edfa54e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:36.211204 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ba3e3a21-7324-453a-8fe7-54639edfa54e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:36.211933 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ba3e3a21-7324-453a-8fe7-54639edfa54e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:36.213017 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ba3e3a21-7324-453a-8fe7-54639edfa54e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:36.301888 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-12929b21-4a8d-40ca-b294-444c717ec348 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:36.318510 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-12929b21-4a8d-40ca-b294-444c717ec348 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1521 microversion: 2.1 time: 0.383030 Sep 02 05:25:36.319257 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 239/474] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:35 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:25:36.418025 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-ba3e3a21-7324-453a-8fe7-54639edfa54e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:36.427485 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-ba3e3a21-7324-453a-8fe7-54639edfa54e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1363 microversion: 2.1 time: 0.232005 Sep 02 05:25:36.428052 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 236/475] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:36 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:37.178955 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-bba2e018-80d8-4afb-be4f-205ba7b62d6c tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:37.179600 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-bba2e018-80d8-4afb-be4f-205ba7b62d6c tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:37.187064 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bba2e018-80d8-4afb-be4f-205ba7b62d6c tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:37.187553 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bba2e018-80d8-4afb-be4f-205ba7b62d6c tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:37.187993 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bba2e018-80d8-4afb-be4f-205ba7b62d6c tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:37.188722 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bba2e018-80d8-4afb-be4f-205ba7b62d6c tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:37.189177 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bba2e018-80d8-4afb-be4f-205ba7b62d6c tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:37.189600 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bba2e018-80d8-4afb-be4f-205ba7b62d6c tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:37.332399 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-bba2e018-80d8-4afb-be4f-205ba7b62d6c tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:37.339414 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-17f98215-449f-41ed-a44a-b6f55e99b8f8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:37.340160 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-17f98215-449f-41ed-a44a-b6f55e99b8f8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:37.340651 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-bba2e018-80d8-4afb-be4f-205ba7b62d6c tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1272 microversion: 2.1 time: 0.165520 Sep 02 05:25:37.341223 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 240/476] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:37 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1272 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:37.346789 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-17f98215-449f-41ed-a44a-b6f55e99b8f8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:37.347523 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-17f98215-449f-41ed-a44a-b6f55e99b8f8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:37.348057 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-17f98215-449f-41ed-a44a-b6f55e99b8f8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:37.349194 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-17f98215-449f-41ed-a44a-b6f55e99b8f8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:37.349317 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-17f98215-449f-41ed-a44a-b6f55e99b8f8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:37.349811 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-17f98215-449f-41ed-a44a-b6f55e99b8f8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:37.424063 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-c76cfe91-8824-419d-81dc-657c7526834e req-703101e4-6298-41ca-9e72-979580b85be2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9feba72e-7abe-4be7-b75e-51262eb201a1", "tag": "efc651b2-eb48-40f2-aa6e-8bca71be2b42"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:25:37.439734 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-c76cfe91-8824-419d-81dc-657c7526834e req-703101e4-6298-41ca-9e72-979580b85be2 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:37.441314 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-c76cfe91-8824-419d-81dc-657c7526834e req-703101e4-6298-41ca-9e72-979580b85be2 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:37.444542 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-c76cfe91-8824-419d-81dc-657c7526834e req-703101e4-6298-41ca-9e72-979580b85be2 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:37.452364 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=100 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:37.463684 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-c76cfe91-8824-419d-81dc-657c7526834e req-703101e4-6298-41ca-9e72-979580b85be2 service nova] Creating event network-changed:efc651b2-eb48-40f2-aa6e-8bca71be2b42 for instance 9feba72e-7abe-4be7-b75e-51262eb201a1 on hv-cinder-85391 Sep 02 05:25:37.469271 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-c76cfe91-8824-419d-81dc-657c7526834e req-703101e4-6298-41ca-9e72-979580b85be2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058929 Sep 02 05:25:37.469874 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 241/477] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:25:37.475752 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-de01124e-f363-495d-8420-9bf423550cff tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:37.476668 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-de01124e-f363-495d-8420-9bf423550cff tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:37.483371 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-de01124e-f363-495d-8420-9bf423550cff tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:37.483943 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-de01124e-f363-495d-8420-9bf423550cff tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:37.484499 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-de01124e-f363-495d-8420-9bf423550cff tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:37.485378 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-de01124e-f363-495d-8420-9bf423550cff tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:37.485787 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-de01124e-f363-495d-8420-9bf423550cff tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:37.486338 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-de01124e-f363-495d-8420-9bf423550cff tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:37.519164 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-17f98215-449f-41ed-a44a-b6f55e99b8f8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:37.527360 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-17f98215-449f-41ed-a44a-b6f55e99b8f8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1521 microversion: 2.1 time: 0.191894 Sep 02 05:25:37.528003 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 237/478] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:37 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:37.623779 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-de01124e-f363-495d-8420-9bf423550cff tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:37.631596 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-de01124e-f363-495d-8420-9bf423550cff tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1363 microversion: 2.1 time: 0.160484 Sep 02 05:25:37.632254 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 242/479] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:37 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:38.367739 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-6bc3beb2-caa1-453d-a418-496a84d19149 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:38.368961 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-6bc3beb2-caa1-453d-a418-496a84d19149 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:38.380094 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6bc3beb2-caa1-453d-a418-496a84d19149 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:38.380852 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6bc3beb2-caa1-453d-a418-496a84d19149 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:38.381634 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6bc3beb2-caa1-453d-a418-496a84d19149 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:38.382698 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6bc3beb2-caa1-453d-a418-496a84d19149 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:38.383598 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6bc3beb2-caa1-453d-a418-496a84d19149 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:38.384015 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6bc3beb2-caa1-453d-a418-496a84d19149 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:38.522688 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-6bc3beb2-caa1-453d-a418-496a84d19149 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:38.531390 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-6bc3beb2-caa1-453d-a418-496a84d19149 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1260 microversion: 2.1 time: 0.170454 Sep 02 05:25:38.531968 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 238/480] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:38 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:38.548277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-bd78366c-e485-42ab-9b5c-31c4324f150c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:38.548882 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-bd78366c-e485-42ab-9b5c-31c4324f150c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:38.555211 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bd78366c-e485-42ab-9b5c-31c4324f150c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:38.555819 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bd78366c-e485-42ab-9b5c-31c4324f150c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:38.556292 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bd78366c-e485-42ab-9b5c-31c4324f150c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:38.556975 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bd78366c-e485-42ab-9b5c-31c4324f150c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:38.557410 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bd78366c-e485-42ab-9b5c-31c4324f150c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:38.557842 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bd78366c-e485-42ab-9b5c-31c4324f150c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:38.652979 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-800db876-4bf4-423d-bf33-cfe1c94fc78b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:38.653783 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-800db876-4bf4-423d-bf33-cfe1c94fc78b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:38.660040 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-800db876-4bf4-423d-bf33-cfe1c94fc78b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:38.660656 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-800db876-4bf4-423d-bf33-cfe1c94fc78b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:38.661150 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-800db876-4bf4-423d-bf33-cfe1c94fc78b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:38.661938 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-800db876-4bf4-423d-bf33-cfe1c94fc78b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:38.662424 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-800db876-4bf4-423d-bf33-cfe1c94fc78b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:38.662925 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-800db876-4bf4-423d-bf33-cfe1c94fc78b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:38.695668 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-bd78366c-e485-42ab-9b5c-31c4324f150c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:38.703631 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-bd78366c-e485-42ab-9b5c-31c4324f150c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1521 microversion: 2.1 time: 0.159152 Sep 02 05:25:38.704217 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 243/481] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:38 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:38.793274 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-800db876-4bf4-423d-bf33-cfe1c94fc78b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:38.801561 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-800db876-4bf4-423d-bf33-cfe1c94fc78b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1363 microversion: 2.1 time: 0.152483 Sep 02 05:25:38.802181 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 239/482] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:38 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:39.556760 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-f244a83a-2893-4616-b236-ff96cd81f912 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:39.557939 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-f244a83a-2893-4616-b236-ff96cd81f912 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:39.568037 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f244a83a-2893-4616-b236-ff96cd81f912 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:39.568967 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f244a83a-2893-4616-b236-ff96cd81f912 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:39.570040 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f244a83a-2893-4616-b236-ff96cd81f912 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:39.571503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f244a83a-2893-4616-b236-ff96cd81f912 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:39.572451 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f244a83a-2893-4616-b236-ff96cd81f912 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:39.573194 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f244a83a-2893-4616-b236-ff96cd81f912 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:39.723896 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-f244a83a-2893-4616-b236-ff96cd81f912 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:39.724583 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-4c8ddf89-11fb-4640-ad07-c725b977f48c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:39.725191 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-4c8ddf89-11fb-4640-ad07-c725b977f48c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:39.731969 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4c8ddf89-11fb-4640-ad07-c725b977f48c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:39.732479 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-f244a83a-2893-4616-b236-ff96cd81f912 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1260 microversion: 2.1 time: 0.182348 Sep 02 05:25:39.732619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4c8ddf89-11fb-4640-ad07-c725b977f48c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:39.732932 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4c8ddf89-11fb-4640-ad07-c725b977f48c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:39.733093 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 244/483] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:39 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:39.733627 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4c8ddf89-11fb-4640-ad07-c725b977f48c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:39.734082 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4c8ddf89-11fb-4640-ad07-c725b977f48c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:39.734560 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4c8ddf89-11fb-4640-ad07-c725b977f48c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:39.826481 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5b757bd8-ecde-4f7c-b5a3-05aa54026e43 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:39.827089 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5b757bd8-ecde-4f7c-b5a3-05aa54026e43 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:39.833267 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5b757bd8-ecde-4f7c-b5a3-05aa54026e43 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:39.833787 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5b757bd8-ecde-4f7c-b5a3-05aa54026e43 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:39.834197 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5b757bd8-ecde-4f7c-b5a3-05aa54026e43 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:39.834899 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5b757bd8-ecde-4f7c-b5a3-05aa54026e43 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:39.835385 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5b757bd8-ecde-4f7c-b5a3-05aa54026e43 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:39.835773 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5b757bd8-ecde-4f7c-b5a3-05aa54026e43 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:39.866177 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-4c8ddf89-11fb-4640-ad07-c725b977f48c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:39.874507 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-4c8ddf89-11fb-4640-ad07-c725b977f48c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1521 microversion: 2.1 time: 0.154018 Sep 02 05:25:39.875263 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 240/484] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:39 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:39.981261 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5b757bd8-ecde-4f7c-b5a3-05aa54026e43 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:39.993369 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5b757bd8-ecde-4f7c-b5a3-05aa54026e43 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1363 microversion: 2.1 time: 0.170074 Sep 02 05:25:39.993930 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 245/485] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:39 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:25:40.753509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-334a39ca-7557-4359-9f92-3d7539a1b252 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:40.754123 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-334a39ca-7557-4359-9f92-3d7539a1b252 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:40.760878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-334a39ca-7557-4359-9f92-3d7539a1b252 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:40.761353 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-334a39ca-7557-4359-9f92-3d7539a1b252 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:40.761772 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-334a39ca-7557-4359-9f92-3d7539a1b252 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:40.762446 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-334a39ca-7557-4359-9f92-3d7539a1b252 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:40.762886 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-334a39ca-7557-4359-9f92-3d7539a1b252 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:40.763300 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-334a39ca-7557-4359-9f92-3d7539a1b252 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:40.895427 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-6a8673aa-907c-449f-83c2-6f8e122ec3b4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:40.896003 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-334a39ca-7557-4359-9f92-3d7539a1b252 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:40.896165 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-6a8673aa-907c-449f-83c2-6f8e122ec3b4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:40.902466 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6a8673aa-907c-449f-83c2-6f8e122ec3b4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:40.903036 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6a8673aa-907c-449f-83c2-6f8e122ec3b4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:40.903257 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-334a39ca-7557-4359-9f92-3d7539a1b252 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1260 microversion: 2.1 time: 0.153646 Sep 02 05:25:40.903642 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6a8673aa-907c-449f-83c2-6f8e122ec3b4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:40.903863 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 241/486] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:40 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:40.904511 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6a8673aa-907c-449f-83c2-6f8e122ec3b4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:40.905035 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6a8673aa-907c-449f-83c2-6f8e122ec3b4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:40.905527 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6a8673aa-907c-449f-83c2-6f8e122ec3b4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:41.013998 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-63e220d2-ace4-4fdb-8d78-7e9205eb5f18 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:41.014776 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-63e220d2-ace4-4fdb-8d78-7e9205eb5f18 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:41.021047 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-63e220d2-ace4-4fdb-8d78-7e9205eb5f18 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:41.021640 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-63e220d2-ace4-4fdb-8d78-7e9205eb5f18 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:41.022133 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-63e220d2-ace4-4fdb-8d78-7e9205eb5f18 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:41.022885 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-63e220d2-ace4-4fdb-8d78-7e9205eb5f18 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:41.023381 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-63e220d2-ace4-4fdb-8d78-7e9205eb5f18 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:41.023807 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-63e220d2-ace4-4fdb-8d78-7e9205eb5f18 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:41.042859 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-6a8673aa-907c-449f-83c2-6f8e122ec3b4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:41.051262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-6a8673aa-907c-449f-83c2-6f8e122ec3b4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1521 microversion: 2.1 time: 0.160020 Sep 02 05:25:41.051931 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 246/487] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:40 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:41.156343 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-63e220d2-ace4-4fdb-8d78-7e9205eb5f18 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:41.164029 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-63e220d2-ace4-4fdb-8d78-7e9205eb5f18 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1363 microversion: 2.1 time: 0.153977 Sep 02 05:25:41.164759 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 242/488] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:41 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:41.926919 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-91353d78-d5f6-44c6-886a-eecb9563f304 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:41.927907 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-91353d78-d5f6-44c6-886a-eecb9563f304 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:41.937964 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-91353d78-d5f6-44c6-886a-eecb9563f304 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:41.938855 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-91353d78-d5f6-44c6-886a-eecb9563f304 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:41.939462 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-91353d78-d5f6-44c6-886a-eecb9563f304 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:41.940773 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-91353d78-d5f6-44c6-886a-eecb9563f304 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:41.941520 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-91353d78-d5f6-44c6-886a-eecb9563f304 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:41.942220 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-91353d78-d5f6-44c6-886a-eecb9563f304 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:42.072149 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-8d5ce2b0-119f-42f3-822b-21aab4cd8480 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:42.072763 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-8d5ce2b0-119f-42f3-822b-21aab4cd8480 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:42.080152 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8d5ce2b0-119f-42f3-822b-21aab4cd8480 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:42.080667 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8d5ce2b0-119f-42f3-822b-21aab4cd8480 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:42.081086 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8d5ce2b0-119f-42f3-822b-21aab4cd8480 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:42.081800 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8d5ce2b0-119f-42f3-822b-21aab4cd8480 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:42.082258 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8d5ce2b0-119f-42f3-822b-21aab4cd8480 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:42.082707 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8d5ce2b0-119f-42f3-822b-21aab4cd8480 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:42.086205 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-91353d78-d5f6-44c6-886a-eecb9563f304 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:42.093975 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-91353d78-d5f6-44c6-886a-eecb9563f304 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1260 microversion: 2.1 time: 0.173570 Sep 02 05:25:42.100168 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 247/489] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:41 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:42.185818 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-1efaf9ee-91e3-4a00-b6a5-675e5db3bdbc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:42.186460 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-1efaf9ee-91e3-4a00-b6a5-675e5db3bdbc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:42.192721 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1efaf9ee-91e3-4a00-b6a5-675e5db3bdbc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:42.193440 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1efaf9ee-91e3-4a00-b6a5-675e5db3bdbc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:42.193882 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1efaf9ee-91e3-4a00-b6a5-675e5db3bdbc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:42.194570 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1efaf9ee-91e3-4a00-b6a5-675e5db3bdbc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:42.195054 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1efaf9ee-91e3-4a00-b6a5-675e5db3bdbc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:42.195484 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1efaf9ee-91e3-4a00-b6a5-675e5db3bdbc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:42.220922 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-8d5ce2b0-119f-42f3-822b-21aab4cd8480 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:42.223206 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=100 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:42.230710 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-8d5ce2b0-119f-42f3-822b-21aab4cd8480 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1521 microversion: 2.1 time: 0.162451 Sep 02 05:25:42.231367 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 243/490] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:42 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:42.342963 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1efaf9ee-91e3-4a00-b6a5-675e5db3bdbc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:42.350919 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-1efaf9ee-91e3-4a00-b6a5-675e5db3bdbc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1363 microversion: 2.1 time: 0.169024 Sep 02 05:25:42.351472 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 248/491] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:42 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:25:43.115074 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-9cd4acde-3971-4de2-a5d5-9a29295cb681 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:43.115765 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-9cd4acde-3971-4de2-a5d5-9a29295cb681 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:43.123040 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9cd4acde-3971-4de2-a5d5-9a29295cb681 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:43.123523 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9cd4acde-3971-4de2-a5d5-9a29295cb681 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:43.123970 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9cd4acde-3971-4de2-a5d5-9a29295cb681 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:43.124728 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9cd4acde-3971-4de2-a5d5-9a29295cb681 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:43.125176 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9cd4acde-3971-4de2-a5d5-9a29295cb681 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:43.125584 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9cd4acde-3971-4de2-a5d5-9a29295cb681 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:43.252932 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-8e0add7d-0da9-476d-ae68-9f4f17e4c610 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:43.253729 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-8e0add7d-0da9-476d-ae68-9f4f17e4c610 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:43.260434 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8e0add7d-0da9-476d-ae68-9f4f17e4c610 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:43.261147 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8e0add7d-0da9-476d-ae68-9f4f17e4c610 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:43.261507 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8e0add7d-0da9-476d-ae68-9f4f17e4c610 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:43.262250 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8e0add7d-0da9-476d-ae68-9f4f17e4c610 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:43.262705 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8e0add7d-0da9-476d-ae68-9f4f17e4c610 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:43.263125 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8e0add7d-0da9-476d-ae68-9f4f17e4c610 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:43.275972 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-9cd4acde-3971-4de2-a5d5-9a29295cb681 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:43.283859 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-9cd4acde-3971-4de2-a5d5-9a29295cb681 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1260 microversion: 2.1 time: 0.173089 Sep 02 05:25:43.284429 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 244/492] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:43 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:43.371329 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d4a9d0d5-2a12-471c-9605-57e29573dc51 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:43.371930 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-d4a9d0d5-2a12-471c-9605-57e29573dc51 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:43.378083 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d4a9d0d5-2a12-471c-9605-57e29573dc51 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:43.378559 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d4a9d0d5-2a12-471c-9605-57e29573dc51 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:43.378985 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d4a9d0d5-2a12-471c-9605-57e29573dc51 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:43.379686 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d4a9d0d5-2a12-471c-9605-57e29573dc51 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:43.380105 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d4a9d0d5-2a12-471c-9605-57e29573dc51 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:43.380560 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d4a9d0d5-2a12-471c-9605-57e29573dc51 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:43.401647 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-8e0add7d-0da9-476d-ae68-9f4f17e4c610 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:43.411013 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-8e0add7d-0da9-476d-ae68-9f4f17e4c610 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1521 microversion: 2.1 time: 0.163020 Sep 02 05:25:43.411580 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 249/493] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:43 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:43.513420 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d4a9d0d5-2a12-471c-9605-57e29573dc51 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:43.525220 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-d4a9d0d5-2a12-471c-9605-57e29573dc51 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1363 microversion: 2.1 time: 0.157903 Sep 02 05:25:43.526064 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 245/494] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:43 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:44.304846 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-a755f246-f767-474f-ac7b-761df2dc18c7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:44.306204 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-a755f246-f767-474f-ac7b-761df2dc18c7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:44.312477 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a755f246-f767-474f-ac7b-761df2dc18c7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:44.312964 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a755f246-f767-474f-ac7b-761df2dc18c7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:44.313598 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a755f246-f767-474f-ac7b-761df2dc18c7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:44.314518 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a755f246-f767-474f-ac7b-761df2dc18c7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:44.315177 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a755f246-f767-474f-ac7b-761df2dc18c7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:44.316096 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a755f246-f767-474f-ac7b-761df2dc18c7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:44.431098 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-c76c0eac-c99a-4038-a5fa-d31423b220fc tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:44.431762 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-c76c0eac-c99a-4038-a5fa-d31423b220fc tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:44.438945 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c76c0eac-c99a-4038-a5fa-d31423b220fc tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:44.439438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c76c0eac-c99a-4038-a5fa-d31423b220fc tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:44.439873 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c76c0eac-c99a-4038-a5fa-d31423b220fc tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:44.440676 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c76c0eac-c99a-4038-a5fa-d31423b220fc tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:44.441128 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c76c0eac-c99a-4038-a5fa-d31423b220fc tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:44.441548 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c76c0eac-c99a-4038-a5fa-d31423b220fc tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:44.457118 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-a755f246-f767-474f-ac7b-761df2dc18c7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:44.464850 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-a755f246-f767-474f-ac7b-761df2dc18c7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1260 microversion: 2.1 time: 0.163856 Sep 02 05:25:44.465313 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 250/495] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:44 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:44.478929 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-57e371da-c969-41b3-8a2d-66813d945fb0 req-9c3a22c3-dc81-490a-890e-5a4fdabed376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "387fc985-a99f-4805-ab55-641d3fe7cc27", "name": "network-vif-plugged", "status": "completed", "tag": "fb24bf1a-8f67-4eb6-b5bb-47d994b3c852"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:25:44.491169 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-57e371da-c969-41b3-8a2d-66813d945fb0 req-9c3a22c3-dc81-490a-890e-5a4fdabed376 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:44.491841 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-57e371da-c969-41b3-8a2d-66813d945fb0 req-9c3a22c3-dc81-490a-890e-5a4fdabed376 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:44.492625 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-57e371da-c969-41b3-8a2d-66813d945fb0 req-9c3a22c3-dc81-490a-890e-5a4fdabed376 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:44.506662 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-57e371da-c969-41b3-8a2d-66813d945fb0 req-9c3a22c3-dc81-490a-890e-5a4fdabed376 service nova] Creating event network-vif-plugged:fb24bf1a-8f67-4eb6-b5bb-47d994b3c852 for instance 387fc985-a99f-4805-ab55-641d3fe7cc27 on hv-cinder-85391 Sep 02 05:25:44.513003 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-57e371da-c969-41b3-8a2d-66813d945fb0 req-9c3a22c3-dc81-490a-890e-5a4fdabed376 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039319 Sep 02 05:25:44.513904 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 251/496] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:25:44.553430 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5535b7e2-6332-4ae4-931b-89dd1e1dce1d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:44.554224 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5535b7e2-6332-4ae4-931b-89dd1e1dce1d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:44.561012 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5535b7e2-6332-4ae4-931b-89dd1e1dce1d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:44.562373 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5535b7e2-6332-4ae4-931b-89dd1e1dce1d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:44.563308 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5535b7e2-6332-4ae4-931b-89dd1e1dce1d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:44.564028 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5535b7e2-6332-4ae4-931b-89dd1e1dce1d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:44.564510 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5535b7e2-6332-4ae4-931b-89dd1e1dce1d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:44.565350 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5535b7e2-6332-4ae4-931b-89dd1e1dce1d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:44.657085 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c76c0eac-c99a-4038-a5fa-d31423b220fc tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:44.664980 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-c76c0eac-c99a-4038-a5fa-d31423b220fc tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1501 microversion: 2.1 time: 0.237915 Sep 02 05:25:44.665553 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 246/497] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:44 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1501 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:44.688732 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-449c06a8-f510-4499-afac-ccd9a4a5ba9b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c84ba5ea-c9b9-48a0-9185-0a64869d0ee3"}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:25:44.692955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-449c06a8-f510-4499-afac-ccd9a4a5ba9b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:44.697435 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-449c06a8-f510-4499-afac-ccd9a4a5ba9b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:44.697972 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-449c06a8-f510-4499-afac-ccd9a4a5ba9b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:44.698390 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-449c06a8-f510-4499-afac-ccd9a4a5ba9b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:44.699511 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-449c06a8-f510-4499-afac-ccd9a4a5ba9b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:44.699511 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-449c06a8-f510-4499-afac-ccd9a4a5ba9b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:44.699977 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-449c06a8-f510-4499-afac-ccd9a4a5ba9b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:44.726052 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5535b7e2-6332-4ae4-931b-89dd1e1dce1d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:44.728502 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.wsgi [None req-449c06a8-f510-4499-afac-ccd9a4a5ba9b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] HTTP exception thrown: Cannot 'attach_volume' instance 67493ca3-e212-45fa-886f-5c2bc5239f0b while it is in vm_state rescued Sep 02 05:25:44.730492 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-449c06a8-f510-4499-afac-ccd9a4a5ba9b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Request method failure captured: Sep 02 05:25:44.730492 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: request: POST /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b/os-volume_attachments HTTP/1.1 Sep 02 05:25:44.730492 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept: application/json Sep 02 05:25:44.730492 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept-Encoding: identity Sep 02 05:25:44.730492 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Connection: close Sep 02 05:25:44.730492 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Length: 74 Sep 02 05:25:44.730492 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Type: application/json Sep 02 05:25:44.730492 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Host: 10.222.0.30 Sep 02 05:25:44.730492 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Openstack-System-Scope: None Sep 02 05:25:44.730492 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: User-Agent: python-urllib3/1.26.12 Sep 02 05:25:44.730492 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Auth-Token: gAAAAABjEZNBlGshjFXTj3Lb-EsC2OrvCSUzgDqiBOUbh8k6e0DYXEDuZx7d2X75THMEeewYJFzTyJmM3mcIGQBFVZgGuF590inOhOXA9tdLJRxjl4ttomYD3QOlAB_biUP2CACfOsx1otZIYpC4WWkCXsXkROF6dcYM2y0smQkEpR6j2BEgLD0 Sep 02 05:25:44.730492 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Id: None Sep 02 05:25:44.730492 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Name: None Sep 02 05:25:44.730492 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Identity-Status: Confirmed Sep 02 05:25:44.730492 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Is-Admin-Project: True Sep 02 05:25:44.730492 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Id: default Sep 02 05:25:44.730492 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Name: Default Sep 02 05:25:44.730492 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Id: 8eb15e49aead4c2987f1ac32180db505 Sep 02 05:25:44.730492 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1496035544 Sep 02 05:25:44.730492 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Role: member,reader Sep 02 05:25:44.730492 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Roles: member,reader Sep 02 05:25:44.731948 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8eb15e49aead4c2987f1ac32180db505"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8eb15e49aead4c2987f1ac32180db505"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8eb15e49aead4c2987f1ac32180db505"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8eb15e49aead4c2987f1ac32180db505"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:25:44.731948 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1496035544 Sep 02 05:25:44.731948 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Id: 8eb15e49aead4c2987f1ac32180db505 Sep 02 05:25:44.731948 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1496035544 Sep 02 05:25:44.731948 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User: tempest-ServerRescueNegativeTestJSON-1496035544-project Sep 02 05:25:44.731948 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Id: default Sep 02 05:25:44.731948 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Name: Default Sep 02 05:25:44.731948 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Id: d27e9069d6c4406292c48ea81b2bc78a Sep 02 05:25:44.731948 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1496035544-project Sep 02 05:25:44.731948 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Sep 02 05:25:44.731948 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {"volumeAttachment": {"volumeId": "c84ba5ea-c9b9-48a0-9185-0a64869d0ee3"}} Sep 02 05:25:44.731948 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: method: > Sep 02 05:25:44.732773 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: exception: Cannot 'attach_volume' instance 67493ca3-e212-45fa-886f-5c2bc5239f0b while it is in vm_state rescued Sep 02 05:25:44.732773 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: action_args: {'server_id': '67493ca3-e212-45fa-886f-5c2bc5239f0b', 'body': {'volumeAttachment': {'volumeId': 'c84ba5ea-c9b9-48a0-9185-0a64869d0ee3'}}} Sep 02 05:25:44.732773 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:25:44.732773 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:25:44.732773 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 02 05:25:44.732773 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 02 05:25:44.732773 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 05:25:44.732773 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 05:25:44.732773 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 02 05:25:44.732773 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 02 05:25:44.732773 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 67493ca3-e212-45fa-886f-5c2bc5239f0b in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 02 05:25:44.732773 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:25:44.732773 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:25:44.732773 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:25:44.732773 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:25:44.732773 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:25:44.732773 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:25:44.732773 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:25:44.732773 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:25:44.734138 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:25:44.734138 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:25:44.734138 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 05:25:44.734138 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 05:25:44.734138 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 05:25:44.734138 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 05:25:44.734138 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 05:25:44.734138 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 05:25:44.734138 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 02 05:25:44.734138 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 02 05:25:44.734138 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 02 05:25:44.734138 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 02 05:25:44.734138 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 67493ca3-e212-45fa-886f-5c2bc5239f0b while it is in vm_state rescued Sep 02 05:25:44.734138 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:25:44.734138 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:25:44.734138 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:25:44.734138 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:25:44.734138 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:25:44.734138 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:25:44.736806 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:25:44.736806 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:25:44.736806 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 67493ca3-e212-45fa-886f-5c2bc5239f0b while it is in vm_state rescued Sep 02 05:25:44.736806 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:25:44.736806 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-449c06a8-f510-4499-afac-ccd9a4a5ba9b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Returning 409 to user: Cannot 'attach_volume' instance 67493ca3-e212-45fa-886f-5c2bc5239f0b while it is in vm_state rescued {{(pid=120448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:25:44.736806 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-449c06a8-f510-4499-afac-ccd9a4a5ba9b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "POST /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047144 Sep 02 05:25:44.736806 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 247/498] 10.222.0.30 () {60 vars in 1323 bytes} [Fri Sep 2 05:25:44 2022] POST /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 02 05:25:44.737717 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5535b7e2-6332-4ae4-931b-89dd1e1dce1d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1363 microversion: 2.1 time: 0.186399 Sep 02 05:25:44.737717 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 252/499] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:44 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:44.740882 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-adab3e26-0f57-4540-b075-19500b23cb55 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:25:44.741403 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-adab3e26-0f57-4540-b075-19500b23cb55 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:44.750095 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-adab3e26-0f57-4540-b075-19500b23cb55 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:44.750610 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-adab3e26-0f57-4540-b075-19500b23cb55 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:44.751041 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-adab3e26-0f57-4540-b075-19500b23cb55 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:44.751794 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-adab3e26-0f57-4540-b075-19500b23cb55 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:44.752305 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-adab3e26-0f57-4540-b075-19500b23cb55 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:44.752727 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-adab3e26-0f57-4540-b075-19500b23cb55 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:44.825612 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-adab3e26-0f57-4540-b075-19500b23cb55 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "POST /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b/action" status: 202 len: 0 microversion: 2.1 time: 0.088100 Sep 02 05:25:44.826479 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 248/500] 10.222.0.30 () {60 vars in 1278 bytes} [Fri Sep 2 05:25:44 2022] POST /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:25:44.834462 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-8424bdc6-154f-459c-9da0-b81bbe2e6a2c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:44.835093 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-8424bdc6-154f-459c-9da0-b81bbe2e6a2c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:44.841651 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8424bdc6-154f-459c-9da0-b81bbe2e6a2c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:44.842015 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8424bdc6-154f-459c-9da0-b81bbe2e6a2c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:44.842675 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8424bdc6-154f-459c-9da0-b81bbe2e6a2c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:44.843377 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8424bdc6-154f-459c-9da0-b81bbe2e6a2c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:44.843870 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8424bdc6-154f-459c-9da0-b81bbe2e6a2c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:44.844327 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8424bdc6-154f-459c-9da0-b81bbe2e6a2c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:44.999192 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-8424bdc6-154f-459c-9da0-b81bbe2e6a2c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:45.007854 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-8424bdc6-154f-459c-9da0-b81bbe2e6a2c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1509 microversion: 2.1 time: 0.177100 Sep 02 05:25:45.008845 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 253/501] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:44 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:45.489657 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-25afb4f2-98e4-4d6d-be6f-991f7a0c4420 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:45.490590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-25afb4f2-98e4-4d6d-be6f-991f7a0c4420 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:45.501075 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-25afb4f2-98e4-4d6d-be6f-991f7a0c4420 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:45.501769 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-25afb4f2-98e4-4d6d-be6f-991f7a0c4420 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:45.502407 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-25afb4f2-98e4-4d6d-be6f-991f7a0c4420 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:45.503473 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-25afb4f2-98e4-4d6d-be6f-991f7a0c4420 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:45.504203 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-25afb4f2-98e4-4d6d-be6f-991f7a0c4420 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:45.504784 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-25afb4f2-98e4-4d6d-be6f-991f7a0c4420 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:45.648570 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-25afb4f2-98e4-4d6d-be6f-991f7a0c4420 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:45.656869 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-25afb4f2-98e4-4d6d-be6f-991f7a0c4420 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1260 microversion: 2.1 time: 0.173665 Sep 02 05:25:45.657420 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 249/502] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:45 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:45.758617 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-a92a8a52-432a-4116-b2ac-a04d3ed8a165 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:45.759255 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-a92a8a52-432a-4116-b2ac-a04d3ed8a165 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:45.765813 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a92a8a52-432a-4116-b2ac-a04d3ed8a165 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:45.766325 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a92a8a52-432a-4116-b2ac-a04d3ed8a165 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:45.766804 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a92a8a52-432a-4116-b2ac-a04d3ed8a165 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:45.767495 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a92a8a52-432a-4116-b2ac-a04d3ed8a165 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:45.767949 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a92a8a52-432a-4116-b2ac-a04d3ed8a165 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:45.768410 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a92a8a52-432a-4116-b2ac-a04d3ed8a165 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:45.907067 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-a92a8a52-432a-4116-b2ac-a04d3ed8a165 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:45.920172 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-a92a8a52-432a-4116-b2ac-a04d3ed8a165 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1363 microversion: 2.1 time: 0.167495 Sep 02 05:25:45.920771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 254/503] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:45 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:46.030123 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-dc9d7936-385c-4c5a-81a2-3a7588f4dce9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:46.030745 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-dc9d7936-385c-4c5a-81a2-3a7588f4dce9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:46.042454 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dc9d7936-385c-4c5a-81a2-3a7588f4dce9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:46.043070 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dc9d7936-385c-4c5a-81a2-3a7588f4dce9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:46.043496 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dc9d7936-385c-4c5a-81a2-3a7588f4dce9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:46.044221 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dc9d7936-385c-4c5a-81a2-3a7588f4dce9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:46.044674 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dc9d7936-385c-4c5a-81a2-3a7588f4dce9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:46.045097 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dc9d7936-385c-4c5a-81a2-3a7588f4dce9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:46.176101 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-dc9d7936-385c-4c5a-81a2-3a7588f4dce9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:46.183830 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-dc9d7936-385c-4c5a-81a2-3a7588f4dce9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1509 microversion: 2.1 time: 0.157694 Sep 02 05:25:46.185025 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 250/504] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:46 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:46.682788 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-6546e264-824d-438d-a6de-24f43ebe023c tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:46.683402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-6546e264-824d-438d-a6de-24f43ebe023c tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:46.690053 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6546e264-824d-438d-a6de-24f43ebe023c tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:46.694493 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6546e264-824d-438d-a6de-24f43ebe023c tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:46.695034 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6546e264-824d-438d-a6de-24f43ebe023c tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:46.696004 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6546e264-824d-438d-a6de-24f43ebe023c tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:46.696598 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6546e264-824d-438d-a6de-24f43ebe023c tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:46.697103 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6546e264-824d-438d-a6de-24f43ebe023c tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:46.904693 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-6546e264-824d-438d-a6de-24f43ebe023c tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:46.912934 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-6546e264-824d-438d-a6de-24f43ebe023c tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1260 microversion: 2.1 time: 0.238068 Sep 02 05:25:46.914022 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 255/505] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:46 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:46.944797 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-edd298c0-b588-4622-8581-29bfc66eb5d2 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:46.945411 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-edd298c0-b588-4622-8581-29bfc66eb5d2 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:46.951936 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-edd298c0-b588-4622-8581-29bfc66eb5d2 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:46.952644 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-edd298c0-b588-4622-8581-29bfc66eb5d2 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:46.953245 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-edd298c0-b588-4622-8581-29bfc66eb5d2 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:46.954099 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-edd298c0-b588-4622-8581-29bfc66eb5d2 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:46.954697 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-edd298c0-b588-4622-8581-29bfc66eb5d2 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:46.955272 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-edd298c0-b588-4622-8581-29bfc66eb5d2 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:47.097969 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-edd298c0-b588-4622-8581-29bfc66eb5d2 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:47.106420 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-edd298c0-b588-4622-8581-29bfc66eb5d2 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1363 microversion: 2.1 time: 0.165419 Sep 02 05:25:47.123503 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 251/506] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:46 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:47.206747 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-d6160e7e-0c35-436a-9c21-96679c10662c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:47.207627 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-d6160e7e-0c35-436a-9c21-96679c10662c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:47.214324 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d6160e7e-0c35-436a-9c21-96679c10662c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:47.214804 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d6160e7e-0c35-436a-9c21-96679c10662c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:47.215415 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d6160e7e-0c35-436a-9c21-96679c10662c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:47.216310 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d6160e7e-0c35-436a-9c21-96679c10662c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:47.216764 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d6160e7e-0c35-436a-9c21-96679c10662c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:47.217193 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d6160e7e-0c35-436a-9c21-96679c10662c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:47.390128 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-d6160e7e-0c35-436a-9c21-96679c10662c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:47.399878 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-d6160e7e-0c35-436a-9c21-96679c10662c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1509 microversion: 2.1 time: 0.196985 Sep 02 05:25:47.401499 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 256/507] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:47 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1509 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:47.933512 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-c3513519-92c4-4728-ac61-e8afd670e94c tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:47.934406 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-c3513519-92c4-4728-ac61-e8afd670e94c tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:47.941269 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c3513519-92c4-4728-ac61-e8afd670e94c tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:47.942023 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c3513519-92c4-4728-ac61-e8afd670e94c tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:47.942721 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c3513519-92c4-4728-ac61-e8afd670e94c tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:47.943511 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c3513519-92c4-4728-ac61-e8afd670e94c tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:47.943982 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c3513519-92c4-4728-ac61-e8afd670e94c tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:47.944471 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c3513519-92c4-4728-ac61-e8afd670e94c tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:48.097961 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c3513519-92c4-4728-ac61-e8afd670e94c tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:48.107005 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-c3513519-92c4-4728-ac61-e8afd670e94c tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1260 microversion: 2.1 time: 0.177291 Sep 02 05:25:48.107572 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 252/508] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:47 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:48.126740 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-8b483bb3-673a-4665-8087-fff97e7b0a3c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:48.127327 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-8b483bb3-673a-4665-8087-fff97e7b0a3c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:48.133141 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_api:SELECT=100 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:48.135095 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8b483bb3-673a-4665-8087-fff97e7b0a3c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:48.135586 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8b483bb3-673a-4665-8087-fff97e7b0a3c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:48.136020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8b483bb3-673a-4665-8087-fff97e7b0a3c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:48.136745 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8b483bb3-673a-4665-8087-fff97e7b0a3c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:48.137200 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8b483bb3-673a-4665-8087-fff97e7b0a3c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:48.137623 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8b483bb3-673a-4665-8087-fff97e7b0a3c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:48.296821 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-8b483bb3-673a-4665-8087-fff97e7b0a3c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:48.304631 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-8b483bb3-673a-4665-8087-fff97e7b0a3c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1363 microversion: 2.1 time: 0.181736 Sep 02 05:25:48.317929 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 257/509] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:48 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:48.420007 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-dcfcfb8f-9ac5-4941-a88f-584ea96557de tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:48.420983 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-dcfcfb8f-9ac5-4941-a88f-584ea96557de tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:48.427567 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dcfcfb8f-9ac5-4941-a88f-584ea96557de tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:48.428334 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dcfcfb8f-9ac5-4941-a88f-584ea96557de tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:48.428766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dcfcfb8f-9ac5-4941-a88f-584ea96557de tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:48.429724 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dcfcfb8f-9ac5-4941-a88f-584ea96557de tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:48.430292 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dcfcfb8f-9ac5-4941-a88f-584ea96557de tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:48.430751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dcfcfb8f-9ac5-4941-a88f-584ea96557de tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:48.647369 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-dcfcfb8f-9ac5-4941-a88f-584ea96557de tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:48.658995 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-dcfcfb8f-9ac5-4941-a88f-584ea96557de tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1509 microversion: 2.1 time: 0.242731 Sep 02 05:25:48.666664 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 253/510] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:48 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1509 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:49.131715 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-02259eee-86ac-487c-9d11-bcb6628c102f tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:49.132333 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-02259eee-86ac-487c-9d11-bcb6628c102f tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:49.138632 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-02259eee-86ac-487c-9d11-bcb6628c102f tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:49.139108 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-02259eee-86ac-487c-9d11-bcb6628c102f tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:49.139539 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-02259eee-86ac-487c-9d11-bcb6628c102f tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:49.140272 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-02259eee-86ac-487c-9d11-bcb6628c102f tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:49.140723 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-02259eee-86ac-487c-9d11-bcb6628c102f tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:49.141138 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-02259eee-86ac-487c-9d11-bcb6628c102f tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:49.278926 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-02259eee-86ac-487c-9d11-bcb6628c102f tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:49.286730 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-02259eee-86ac-487c-9d11-bcb6628c102f tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1260 microversion: 2.1 time: 0.158881 Sep 02 05:25:49.287287 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 258/511] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:49 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:49.326938 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-15bdf419-ce06-4443-8854-65bbc370fb42 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:49.327695 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-15bdf419-ce06-4443-8854-65bbc370fb42 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:49.337932 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-15bdf419-ce06-4443-8854-65bbc370fb42 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:49.338743 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-15bdf419-ce06-4443-8854-65bbc370fb42 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:49.339375 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-15bdf419-ce06-4443-8854-65bbc370fb42 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:49.340587 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-15bdf419-ce06-4443-8854-65bbc370fb42 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:49.341506 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-15bdf419-ce06-4443-8854-65bbc370fb42 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:49.342370 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-15bdf419-ce06-4443-8854-65bbc370fb42 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:49.570061 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-15bdf419-ce06-4443-8854-65bbc370fb42 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:49.578066 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-15bdf419-ce06-4443-8854-65bbc370fb42 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1548 microversion: 2.1 time: 0.256394 Sep 02 05:25:49.578605 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 254/512] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:49 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1548 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:49.597787 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5b44832c-989d-4d2f-955f-d18cff5fbd4d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:49.598545 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5b44832c-989d-4d2f-955f-d18cff5fbd4d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:49.605004 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5b44832c-989d-4d2f-955f-d18cff5fbd4d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:49.606338 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5b44832c-989d-4d2f-955f-d18cff5fbd4d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:49.606950 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5b44832c-989d-4d2f-955f-d18cff5fbd4d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:49.607816 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5b44832c-989d-4d2f-955f-d18cff5fbd4d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:49.608465 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5b44832c-989d-4d2f-955f-d18cff5fbd4d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:49.609040 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5b44832c-989d-4d2f-955f-d18cff5fbd4d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:49.613168 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=100 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:49.682632 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-69231dc4-9145-4a44-9f77-f6f54cef53fe tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:49.683368 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-69231dc4-9145-4a44-9f77-f6f54cef53fe tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:49.690985 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-69231dc4-9145-4a44-9f77-f6f54cef53fe tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:49.697787 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-69231dc4-9145-4a44-9f77-f6f54cef53fe tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:49.698814 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-69231dc4-9145-4a44-9f77-f6f54cef53fe tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:49.700310 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-69231dc4-9145-4a44-9f77-f6f54cef53fe tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:49.701406 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-69231dc4-9145-4a44-9f77-f6f54cef53fe tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:49.702081 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-69231dc4-9145-4a44-9f77-f6f54cef53fe tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:49.704651 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5b44832c-989d-4d2f-955f-d18cff5fbd4d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110563 Sep 02 05:25:49.705252 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 259/513] 10.222.0.30 () {58 vars in 1275 bytes} [Fri Sep 2 05:25:49 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:25:50.016249 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-69231dc4-9145-4a44-9f77-f6f54cef53fe tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:50.024081 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-69231dc4-9145-4a44-9f77-f6f54cef53fe tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1509 microversion: 2.1 time: 0.346490 Sep 02 05:25:50.040057 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 255/514] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:49 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1509 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:25:50.307131 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-fe37ca1e-c5d6-4090-a2a7-3fc73523b1e6 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:50.307712 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-fe37ca1e-c5d6-4090-a2a7-3fc73523b1e6 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:50.319405 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fe37ca1e-c5d6-4090-a2a7-3fc73523b1e6 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:50.319899 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fe37ca1e-c5d6-4090-a2a7-3fc73523b1e6 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:50.320412 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fe37ca1e-c5d6-4090-a2a7-3fc73523b1e6 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:50.321327 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fe37ca1e-c5d6-4090-a2a7-3fc73523b1e6 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:50.321932 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fe37ca1e-c5d6-4090-a2a7-3fc73523b1e6 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:50.322507 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fe37ca1e-c5d6-4090-a2a7-3fc73523b1e6 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:50.557821 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-fe37ca1e-c5d6-4090-a2a7-3fc73523b1e6 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:50.568847 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-fe37ca1e-c5d6-4090-a2a7-3fc73523b1e6 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1260 microversion: 2.1 time: 0.265697 Sep 02 05:25:50.570263 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 260/515] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:50 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1260 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:51.048231 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-8613809f-b3ce-4cdc-a6b1-5f29c4190e77 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:51.048841 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-8613809f-b3ce-4cdc-a6b1-5f29c4190e77 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:51.055412 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8613809f-b3ce-4cdc-a6b1-5f29c4190e77 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:51.056202 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8613809f-b3ce-4cdc-a6b1-5f29c4190e77 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:51.056642 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8613809f-b3ce-4cdc-a6b1-5f29c4190e77 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:51.057393 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8613809f-b3ce-4cdc-a6b1-5f29c4190e77 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:51.058108 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8613809f-b3ce-4cdc-a6b1-5f29c4190e77 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:51.058539 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8613809f-b3ce-4cdc-a6b1-5f29c4190e77 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:51.199557 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-2696ff7a-bd41-473c-8ca2-ea3a62a7dcab req-d6190698-1020-4e5b-8a1a-5fc3d0b2776b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "387fc985-a99f-4805-ab55-641d3fe7cc27", "tag": "fb24bf1a-8f67-4eb6-b5bb-47d994b3c852"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:25:51.217070 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-2696ff7a-bd41-473c-8ca2-ea3a62a7dcab req-d6190698-1020-4e5b-8a1a-5fc3d0b2776b service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:51.217639 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-2696ff7a-bd41-473c-8ca2-ea3a62a7dcab req-d6190698-1020-4e5b-8a1a-5fc3d0b2776b service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:51.218133 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-2696ff7a-bd41-473c-8ca2-ea3a62a7dcab req-d6190698-1020-4e5b-8a1a-5fc3d0b2776b service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:51.234995 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-2696ff7a-bd41-473c-8ca2-ea3a62a7dcab req-d6190698-1020-4e5b-8a1a-5fc3d0b2776b service nova] Creating event network-changed:fb24bf1a-8f67-4eb6-b5bb-47d994b3c852 for instance 387fc985-a99f-4805-ab55-641d3fe7cc27 on hv-cinder-85391 Sep 02 05:25:51.243017 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-2696ff7a-bd41-473c-8ca2-ea3a62a7dcab req-d6190698-1020-4e5b-8a1a-5fc3d0b2776b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047588 Sep 02 05:25:51.245976 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 261/516] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:25:51.263214 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-8613809f-b3ce-4cdc-a6b1-5f29c4190e77 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:51.271232 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-8613809f-b3ce-4cdc-a6b1-5f29c4190e77 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1509 microversion: 2.1 time: 0.228034 Sep 02 05:25:51.272943 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 256/517] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:51 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1509 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:51.591162 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5127d810-53d4-4213-9ba4-b1176ac99911 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:51.592927 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5127d810-53d4-4213-9ba4-b1176ac99911 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:51.605241 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5127d810-53d4-4213-9ba4-b1176ac99911 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:51.605975 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5127d810-53d4-4213-9ba4-b1176ac99911 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:51.606526 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5127d810-53d4-4213-9ba4-b1176ac99911 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:51.607550 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5127d810-53d4-4213-9ba4-b1176ac99911 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:51.609055 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5127d810-53d4-4213-9ba4-b1176ac99911 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:51.609711 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5127d810-53d4-4213-9ba4-b1176ac99911 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:51.822990 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5127d810-53d4-4213-9ba4-b1176ac99911 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:51.835089 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5127d810-53d4-4213-9ba4-b1176ac99911 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1260 microversion: 2.1 time: 0.248930 Sep 02 05:25:51.836183 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 262/518] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:51 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1260 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:25:52.292539 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-6d98616f-adeb-4395-9719-0d193fbfa3c3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:52.293164 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-6d98616f-adeb-4395-9719-0d193fbfa3c3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:52.299795 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6d98616f-adeb-4395-9719-0d193fbfa3c3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:52.301042 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6d98616f-adeb-4395-9719-0d193fbfa3c3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:52.301491 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6d98616f-adeb-4395-9719-0d193fbfa3c3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:52.302262 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6d98616f-adeb-4395-9719-0d193fbfa3c3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:52.316836 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6d98616f-adeb-4395-9719-0d193fbfa3c3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:52.316836 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6d98616f-adeb-4395-9719-0d193fbfa3c3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:52.457628 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-6d98616f-adeb-4395-9719-0d193fbfa3c3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:52.466506 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-6d98616f-adeb-4395-9719-0d193fbfa3c3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1509 microversion: 2.1 time: 0.177680 Sep 02 05:25:52.467357 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 257/519] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:52 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:52.855472 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-f86d136a-a58d-4fb4-b016-4079e5aaaac9 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:52.856876 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-f86d136a-a58d-4fb4-b016-4079e5aaaac9 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:52.863639 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f86d136a-a58d-4fb4-b016-4079e5aaaac9 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:52.864362 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f86d136a-a58d-4fb4-b016-4079e5aaaac9 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:52.864965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f86d136a-a58d-4fb4-b016-4079e5aaaac9 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:52.865840 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f86d136a-a58d-4fb4-b016-4079e5aaaac9 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:52.866317 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f86d136a-a58d-4fb4-b016-4079e5aaaac9 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:52.866909 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f86d136a-a58d-4fb4-b016-4079e5aaaac9 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:53.007539 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-f86d136a-a58d-4fb4-b016-4079e5aaaac9 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:53.015667 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-f86d136a-a58d-4fb4-b016-4079e5aaaac9 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1260 microversion: 2.1 time: 0.164091 Sep 02 05:25:53.029034 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 263/520] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:52 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:53.487248 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-a22fdee7-51b9-41e4-9ec9-37d98bcb2cba tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:53.487789 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-a22fdee7-51b9-41e4-9ec9-37d98bcb2cba tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:53.495164 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a22fdee7-51b9-41e4-9ec9-37d98bcb2cba tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:53.495676 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a22fdee7-51b9-41e4-9ec9-37d98bcb2cba tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:53.496101 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a22fdee7-51b9-41e4-9ec9-37d98bcb2cba tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:53.496851 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a22fdee7-51b9-41e4-9ec9-37d98bcb2cba tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:53.497325 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a22fdee7-51b9-41e4-9ec9-37d98bcb2cba tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:53.498070 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a22fdee7-51b9-41e4-9ec9-37d98bcb2cba tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:53.651128 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-a22fdee7-51b9-41e4-9ec9-37d98bcb2cba tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:53.659207 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-a22fdee7-51b9-41e4-9ec9-37d98bcb2cba tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1515 microversion: 2.1 time: 0.176124 Sep 02 05:25:53.660145 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 258/521] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:53 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:54.113394 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-36f263a9-cf4e-4f86-8f5a-faf44acc1148 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:54.114168 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-36f263a9-cf4e-4f86-8f5a-faf44acc1148 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:54.120690 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-36f263a9-cf4e-4f86-8f5a-faf44acc1148 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:54.121242 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-36f263a9-cf4e-4f86-8f5a-faf44acc1148 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:54.121916 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-36f263a9-cf4e-4f86-8f5a-faf44acc1148 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:54.122673 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-36f263a9-cf4e-4f86-8f5a-faf44acc1148 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:54.123326 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-36f263a9-cf4e-4f86-8f5a-faf44acc1148 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:54.123862 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-36f263a9-cf4e-4f86-8f5a-faf44acc1148 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:54.285445 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-36f263a9-cf4e-4f86-8f5a-faf44acc1148 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:54.297488 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-36f263a9-cf4e-4f86-8f5a-faf44acc1148 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1260 microversion: 2.1 time: 0.187953 Sep 02 05:25:54.298292 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 264/522] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:54 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:25:55.321982 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-89b8590b-dcee-4e58-a9da-3830689ec661 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:55.322634 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-89b8590b-dcee-4e58-a9da-3830689ec661 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:55.329343 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-89b8590b-dcee-4e58-a9da-3830689ec661 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:55.329821 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-89b8590b-dcee-4e58-a9da-3830689ec661 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:55.330246 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-89b8590b-dcee-4e58-a9da-3830689ec661 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:55.330925 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-89b8590b-dcee-4e58-a9da-3830689ec661 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:55.331370 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-89b8590b-dcee-4e58-a9da-3830689ec661 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:55.331785 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-89b8590b-dcee-4e58-a9da-3830689ec661 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:55.485503 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-89b8590b-dcee-4e58-a9da-3830689ec661 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:55.489358 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:55.497760 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-89b8590b-dcee-4e58-a9da-3830689ec661 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1260 microversion: 2.1 time: 0.181058 Sep 02 05:25:55.498919 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 259/523] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:55 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:56.162292 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-c35d3ff9-1da9-4a74-9af0-e6290ac5479e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Action: 'create', calling method: .version_select at 0x7fc90b4fef70>, body: {"keypair": {"name": "tempest-keypair-1726394100", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJu+4RzkDWK9CdGSpisRyOud9m/n/x0ELxYhDx3y4ai8DlTsDvvfAojLthXU27poajNEFdGB9wfvRGSb9jjRrXEKmzFBCJb2uQ3TFWXgQ+p2KfDkdxyNkHkbJaBY2YRYxQ=="}} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:25:56.184865 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.quota [None req-c35d3ff9-1da9-4a74-9af0-e6290ac5479e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Getting quotas for project 8eb15e49aead4c2987f1ac32180db505. Resources: {'key_pairs'} {{(pid=120449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:25:56.188680 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.quota [None req-c35d3ff9-1da9-4a74-9af0-e6290ac5479e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Getting quotas for user d27e9069d6c4406292c48ea81b2bc78a and project 8eb15e49aead4c2987f1ac32180db505. Resources: {'key_pairs'} {{(pid=120449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:25:56.232891 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-c35d3ff9-1da9-4a74-9af0-e6290ac5479e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.074267 Sep 02 05:25:56.233619 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 265/524] 10.222.0.30 () {60 vars in 1159 bytes} [Fri Sep 2 05:25:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:25:56.347358 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-20c387fb-8cb0-4146-a762-4db49306a1e9 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e64c8f05-1e14-45ff-8d20-8e015e029ecf", "device": "/dev/sdb"}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:25:56.351196 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-20c387fb-8cb0-4146-a762-4db49306a1e9 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:56.367828 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-20c387fb-8cb0-4146-a762-4db49306a1e9 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:56.368666 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-20c387fb-8cb0-4146-a762-4db49306a1e9 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:56.369188 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-20c387fb-8cb0-4146-a762-4db49306a1e9 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:56.372777 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-20c387fb-8cb0-4146-a762-4db49306a1e9 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:56.373414 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-20c387fb-8cb0-4146-a762-4db49306a1e9 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:56.374113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-20c387fb-8cb0-4146-a762-4db49306a1e9 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:56.522746 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-91afb25b-99a6-41a2-a322-b51f85ad7fad tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:56.523679 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-91afb25b-99a6-41a2-a322-b51f85ad7fad tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:56.532691 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-91afb25b-99a6-41a2-a322-b51f85ad7fad tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:56.533384 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-91afb25b-99a6-41a2-a322-b51f85ad7fad tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:56.534025 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-91afb25b-99a6-41a2-a322-b51f85ad7fad tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:56.534920 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-91afb25b-99a6-41a2-a322-b51f85ad7fad tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:56.535582 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-91afb25b-99a6-41a2-a322-b51f85ad7fad tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:56.536176 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-91afb25b-99a6-41a2-a322-b51f85ad7fad tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:56.803789 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-20c387fb-8cb0-4146-a762-4db49306a1e9 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "POST /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.460582 Sep 02 05:25:56.809937 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 260/525] 10.222.0.30 () {60 vars in 1323 bytes} [Fri Sep 2 05:25:56 2022] POST /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b/os-volume_attachments => generated 194 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:25:56.845543 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-91afb25b-99a6-41a2-a322-b51f85ad7fad tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:56.857963 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-91afb25b-99a6-41a2-a322-b51f85ad7fad tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1260 microversion: 2.1 time: 0.342193 Sep 02 05:25:56.858526 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 266/526] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:56 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1260 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:25:57.856889 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-666b1bbd-4213-4ae4-b622-d36da5417f84 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1174918300", "imageRef": "f3669111-2e3f-4f39-878f-19d263505eaa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa2d68b0-bcd1-4b10-afa0-f7eeee0cab08"}], "security_groups": [{"name": "tempest-securitygroup--1731391275"}], "key_name": "tempest-keypair-1726394100", "user_data": "}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:25:57.879484 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-3a2ae909-d09b-4aa7-9488-33463ea111e7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:57.880317 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-3a2ae909-d09b-4aa7-9488-33463ea111e7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:57.896507 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3a2ae909-d09b-4aa7-9488-33463ea111e7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:57.897170 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3a2ae909-d09b-4aa7-9488-33463ea111e7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:57.897828 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3a2ae909-d09b-4aa7-9488-33463ea111e7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:57.898887 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3a2ae909-d09b-4aa7-9488-33463ea111e7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:57.899500 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3a2ae909-d09b-4aa7-9488-33463ea111e7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:57.900074 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3a2ae909-d09b-4aa7-9488-33463ea111e7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:58.070461 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.network.neutron [None req-666b1bbd-4213-4ae4-b622-d36da5417f84 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] validate_networks() for [('fa2d68b0-bcd1-4b10-afa0-f7eeee0cab08', None, None, None, None, None)] {{(pid=120448) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 05:25:58.142958 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-3a2ae909-d09b-4aa7-9488-33463ea111e7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:58.156184 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-3a2ae909-d09b-4aa7-9488-33463ea111e7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1260 microversion: 2.1 time: 0.280636 Sep 02 05:25:58.168972 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 267/527] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:57 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1260 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:58.304137 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=88 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:58.537989 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-666b1bbd-4213-4ae4-b622-d36da5417f84 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Flavor limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 05:25:58.538867 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-666b1bbd-4213-4ae4-b622-d36da5417f84 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Image limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 05:25:58.539344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-666b1bbd-4213-4ae4-b622-d36da5417f84 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Flavor pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 05:25:58.539866 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-666b1bbd-4213-4ae4-b622-d36da5417f84 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Image pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 05:25:58.540350 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-666b1bbd-4213-4ae4-b622-d36da5417f84 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 05:25:58.551483 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-666b1bbd-4213-4ae4-b622-d36da5417f84 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:58.551882 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-666b1bbd-4213-4ae4-b622-d36da5417f84 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:58.552518 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-666b1bbd-4213-4ae4-b622-d36da5417f84 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:58.553410 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-666b1bbd-4213-4ae4-b622-d36da5417f84 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:58.553860 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-666b1bbd-4213-4ae4-b622-d36da5417f84 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:58.554586 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-666b1bbd-4213-4ae4-b622-d36da5417f84 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:58.576870 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-666b1bbd-4213-4ae4-b622-d36da5417f84 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Getting quotas for project 8eb15e49aead4c2987f1ac32180db505. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:25:58.582253 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-666b1bbd-4213-4ae4-b622-d36da5417f84 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Getting quotas for user d27e9069d6c4406292c48ea81b2bc78a and project 8eb15e49aead4c2987f1ac32180db505. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:25:58.595677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-666b1bbd-4213-4ae4-b622-d36da5417f84 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Going to run 1 instances... {{(pid=120448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 05:25:58.598761 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-666b1bbd-4213-4ae4-b622-d36da5417f84 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3669111-2e3f-4f39-878f-19d263505eaa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 05:25:58.657676 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-666b1bbd-4213-4ae4-b622-d36da5417f84 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.805968 Sep 02 05:25:58.658576 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 261/528] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Sep 2 05:25:57 2022] POST /compute/v2.1/servers => generated 409 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 05:25:58.671738 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-75377a89-93a8-493b-94d9-f1a36b04686f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:58.672757 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-75377a89-93a8-493b-94d9-f1a36b04686f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:58.747847 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-75377a89-93a8-493b-94d9-f1a36b04686f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:58.756727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-75377a89-93a8-493b-94d9-f1a36b04686f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1246 microversion: 2.1 time: 0.090616 Sep 02 05:25:58.757908 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 268/529] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:58 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:25:59.179032 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-273f6451-d956-461f-81a3-22f2d07561ea tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:59.181962 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-273f6451-d956-461f-81a3-22f2d07561ea tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:59.196963 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-273f6451-d956-461f-81a3-22f2d07561ea tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:59.197787 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-273f6451-d956-461f-81a3-22f2d07561ea tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:59.198222 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-273f6451-d956-461f-81a3-22f2d07561ea tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:59.199471 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-273f6451-d956-461f-81a3-22f2d07561ea tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:59.200092 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-273f6451-d956-461f-81a3-22f2d07561ea tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:59.200824 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-273f6451-d956-461f-81a3-22f2d07561ea tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:59.381619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-273f6451-d956-461f-81a3-22f2d07561ea tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:59.390656 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-273f6451-d956-461f-81a3-22f2d07561ea tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1260 microversion: 2.1 time: 0.215639 Sep 02 05:25:59.391856 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 262/530] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:59 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1260 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:25:59.786382 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-0f72ce95-bac2-4087-a010-1d08820f8309 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:25:59.787288 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-0f72ce95-bac2-4087-a010-1d08820f8309 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:25:59.798900 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0f72ce95-bac2-4087-a010-1d08820f8309 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:59.799940 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0f72ce95-bac2-4087-a010-1d08820f8309 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:59.800862 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0f72ce95-bac2-4087-a010-1d08820f8309 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:59.802399 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0f72ce95-bac2-4087-a010-1d08820f8309 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:25:59.803432 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0f72ce95-bac2-4087-a010-1d08820f8309 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:25:59.804777 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0f72ce95-bac2-4087-a010-1d08820f8309 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:25:59.887794 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-0f72ce95-bac2-4087-a010-1d08820f8309 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:25:59.905852 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-0f72ce95-bac2-4087-a010-1d08820f8309 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1298 microversion: 2.1 time: 0.125108 Sep 02 05:25:59.906996 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 269/531] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:25:59 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1298 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:00.414874 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-561689af-386e-468e-a762-078f0194da4f tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:00.415591 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-561689af-386e-468e-a762-078f0194da4f tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:00.422484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-561689af-386e-468e-a762-078f0194da4f tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:00.423063 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-561689af-386e-468e-a762-078f0194da4f tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:00.423553 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-561689af-386e-468e-a762-078f0194da4f tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:00.424367 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-561689af-386e-468e-a762-078f0194da4f tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:00.424910 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-561689af-386e-468e-a762-078f0194da4f tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:00.425386 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-561689af-386e-468e-a762-078f0194da4f tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:00.578785 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-561689af-386e-468e-a762-078f0194da4f tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:00.587772 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-561689af-386e-468e-a762-078f0194da4f tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1260 microversion: 2.1 time: 0.176630 Sep 02 05:26:00.589087 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 263/532] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:00 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:00.898243 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-903c3ccb-a42d-4f87-b47c-975d49f22522 req-dc570919-e9eb-460e-8f43-f0ab4d4af80c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9feba72e-7abe-4be7-b75e-51262eb201a1", "name": "network-vif-plugged", "status": "completed", "tag": "efc651b2-eb48-40f2-aa6e-8bca71be2b42"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:26:00.910505 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-903c3ccb-a42d-4f87-b47c-975d49f22522 req-dc570919-e9eb-460e-8f43-f0ab4d4af80c service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:00.911344 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-903c3ccb-a42d-4f87-b47c-975d49f22522 req-dc570919-e9eb-460e-8f43-f0ab4d4af80c service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:00.912172 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-903c3ccb-a42d-4f87-b47c-975d49f22522 req-dc570919-e9eb-460e-8f43-f0ab4d4af80c service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:00.926428 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-903c3ccb-a42d-4f87-b47c-975d49f22522 req-dc570919-e9eb-460e-8f43-f0ab4d4af80c service nova] Creating event network-vif-plugged:efc651b2-eb48-40f2-aa6e-8bca71be2b42 for instance 9feba72e-7abe-4be7-b75e-51262eb201a1 on hv-cinder-85391 Sep 02 05:26:00.927129 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-737b9c9a-99ae-4bb3-8696-54c9090f6668 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:00.927892 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-737b9c9a-99ae-4bb3-8696-54c9090f6668 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:00.932705 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-903c3ccb-a42d-4f87-b47c-975d49f22522 req-dc570919-e9eb-460e-8f43-f0ab4d4af80c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038101 Sep 02 05:26:00.933927 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 270/533] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:26:00.945411 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-737b9c9a-99ae-4bb3-8696-54c9090f6668 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:00.946013 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-737b9c9a-99ae-4bb3-8696-54c9090f6668 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:00.946524 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-737b9c9a-99ae-4bb3-8696-54c9090f6668 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:00.947309 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-737b9c9a-99ae-4bb3-8696-54c9090f6668 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:00.947841 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-737b9c9a-99ae-4bb3-8696-54c9090f6668 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:00.948384 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-737b9c9a-99ae-4bb3-8696-54c9090f6668 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:01.036911 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-737b9c9a-99ae-4bb3-8696-54c9090f6668 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:01.045078 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-737b9c9a-99ae-4bb3-8696-54c9090f6668 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1304 microversion: 2.1 time: 0.122027 Sep 02 05:26:01.045850 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 264/534] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:00 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:26:01.619635 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-cfa1d483-068c-48cf-84d2-e75d1d7c5037 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:01.621576 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-cfa1d483-068c-48cf-84d2-e75d1d7c5037 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:01.662870 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cfa1d483-068c-48cf-84d2-e75d1d7c5037 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:01.664899 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cfa1d483-068c-48cf-84d2-e75d1d7c5037 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:01.665465 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cfa1d483-068c-48cf-84d2-e75d1d7c5037 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:01.666305 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cfa1d483-068c-48cf-84d2-e75d1d7c5037 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:01.667097 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cfa1d483-068c-48cf-84d2-e75d1d7c5037 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:01.667638 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cfa1d483-068c-48cf-84d2-e75d1d7c5037 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:01.851203 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-cfa1d483-068c-48cf-84d2-e75d1d7c5037 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:01.859474 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-cfa1d483-068c-48cf-84d2-e75d1d7c5037 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1260 microversion: 2.1 time: 0.246231 Sep 02 05:26:01.860059 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 271/535] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:01 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1260 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:02.070651 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-27aa6b9e-d705-4730-b5b3-5f1cfd695245 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:02.071325 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-27aa6b9e-d705-4730-b5b3-5f1cfd695245 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:02.080544 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-27aa6b9e-d705-4730-b5b3-5f1cfd695245 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:02.081044 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-27aa6b9e-d705-4730-b5b3-5f1cfd695245 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:02.081487 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-27aa6b9e-d705-4730-b5b3-5f1cfd695245 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:02.082238 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-27aa6b9e-d705-4730-b5b3-5f1cfd695245 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:02.082687 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-27aa6b9e-d705-4730-b5b3-5f1cfd695245 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:02.083332 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-27aa6b9e-d705-4730-b5b3-5f1cfd695245 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:02.227397 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-27aa6b9e-d705-4730-b5b3-5f1cfd695245 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:02.235949 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-27aa6b9e-d705-4730-b5b3-5f1cfd695245 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1372 microversion: 2.1 time: 0.169738 Sep 02 05:26:02.237047 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 265/536] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:02 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:02.881917 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-f6744de1-7f3d-468f-a46a-9bfb7d94481b tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:02.882644 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-f6744de1-7f3d-468f-a46a-9bfb7d94481b tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:02.888862 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f6744de1-7f3d-468f-a46a-9bfb7d94481b tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:02.889340 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f6744de1-7f3d-468f-a46a-9bfb7d94481b tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:02.889768 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f6744de1-7f3d-468f-a46a-9bfb7d94481b tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:02.890511 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f6744de1-7f3d-468f-a46a-9bfb7d94481b tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:02.890877 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f6744de1-7f3d-468f-a46a-9bfb7d94481b tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:02.891298 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f6744de1-7f3d-468f-a46a-9bfb7d94481b tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:03.035943 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-f6744de1-7f3d-468f-a46a-9bfb7d94481b tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:03.044072 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-f6744de1-7f3d-468f-a46a-9bfb7d94481b tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1260 microversion: 2.1 time: 0.166607 Sep 02 05:26:03.044566 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 272/537] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:02 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:03.260411 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-2ab33570-4bd5-4455-8adf-9474d762269e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:03.261396 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-2ab33570-4bd5-4455-8adf-9474d762269e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:03.272097 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2ab33570-4bd5-4455-8adf-9474d762269e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:03.272944 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2ab33570-4bd5-4455-8adf-9474d762269e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:03.273591 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2ab33570-4bd5-4455-8adf-9474d762269e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:03.274269 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2ab33570-4bd5-4455-8adf-9474d762269e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:03.274715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2ab33570-4bd5-4455-8adf-9474d762269e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:03.275129 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2ab33570-4bd5-4455-8adf-9474d762269e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:03.515876 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-2ab33570-4bd5-4455-8adf-9474d762269e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:03.524641 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-2ab33570-4bd5-4455-8adf-9474d762269e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1372 microversion: 2.1 time: 0.270542 Sep 02 05:26:03.525181 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 266/538] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:03 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1372 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:03.902903 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-4267e07d-cd59-40fc-bda5-a6e180abc2bb req-a1688b5c-fcd9-4e6e-82ba-a2432b61d6e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc1683c4-1646-485d-99de-4b1591af0455", "tag": "9b093d1d-f4c7-44e9-a59c-36fc5dbe9a0a"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:26:03.914500 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-4267e07d-cd59-40fc-bda5-a6e180abc2bb req-a1688b5c-fcd9-4e6e-82ba-a2432b61d6e7 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:03.915114 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-4267e07d-cd59-40fc-bda5-a6e180abc2bb req-a1688b5c-fcd9-4e6e-82ba-a2432b61d6e7 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:03.915538 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-4267e07d-cd59-40fc-bda5-a6e180abc2bb req-a1688b5c-fcd9-4e6e-82ba-a2432b61d6e7 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:03.928066 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-4267e07d-cd59-40fc-bda5-a6e180abc2bb req-a1688b5c-fcd9-4e6e-82ba-a2432b61d6e7 service nova] Creating event network-changed:9b093d1d-f4c7-44e9-a59c-36fc5dbe9a0a for instance dc1683c4-1646-485d-99de-4b1591af0455 on hv-cinder-85391 Sep 02 05:26:03.933247 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-4267e07d-cd59-40fc-bda5-a6e180abc2bb req-a1688b5c-fcd9-4e6e-82ba-a2432b61d6e7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034114 Sep 02 05:26:03.933897 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 273/539] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:26:04.072177 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d25e6661-73c4-4fd4-a90b-6d5b6a1e7e5e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:04.072715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-d25e6661-73c4-4fd4-a90b-6d5b6a1e7e5e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:04.079001 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d25e6661-73c4-4fd4-a90b-6d5b6a1e7e5e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:04.079479 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d25e6661-73c4-4fd4-a90b-6d5b6a1e7e5e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:04.079927 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d25e6661-73c4-4fd4-a90b-6d5b6a1e7e5e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:04.080660 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d25e6661-73c4-4fd4-a90b-6d5b6a1e7e5e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:04.081122 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d25e6661-73c4-4fd4-a90b-6d5b6a1e7e5e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:04.081590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d25e6661-73c4-4fd4-a90b-6d5b6a1e7e5e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:04.234238 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d25e6661-73c4-4fd4-a90b-6d5b6a1e7e5e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:04.242842 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-d25e6661-73c4-4fd4-a90b-6d5b6a1e7e5e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1260 microversion: 2.1 time: 0.174350 Sep 02 05:26:04.243687 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 267/540] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:04 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:04.550248 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-946d84b6-1ca7-4c8a-89a5-4a412cb0fefd tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:04.551426 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-946d84b6-1ca7-4c8a-89a5-4a412cb0fefd tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:04.561695 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-946d84b6-1ca7-4c8a-89a5-4a412cb0fefd tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:04.562480 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-946d84b6-1ca7-4c8a-89a5-4a412cb0fefd tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:04.563188 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-946d84b6-1ca7-4c8a-89a5-4a412cb0fefd tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:04.564359 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-946d84b6-1ca7-4c8a-89a5-4a412cb0fefd tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:04.565101 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-946d84b6-1ca7-4c8a-89a5-4a412cb0fefd tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:04.565794 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-946d84b6-1ca7-4c8a-89a5-4a412cb0fefd tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:04.699765 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-946d84b6-1ca7-4c8a-89a5-4a412cb0fefd tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:04.707529 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-946d84b6-1ca7-4c8a-89a5-4a412cb0fefd tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1372 microversion: 2.1 time: 0.164440 Sep 02 05:26:04.708091 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 274/541] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:04 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:05.266921 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-41716970-848a-47af-887f-c30de4ebf18e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:05.267949 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-41716970-848a-47af-887f-c30de4ebf18e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:05.278628 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-41716970-848a-47af-887f-c30de4ebf18e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:05.279420 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-41716970-848a-47af-887f-c30de4ebf18e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:05.280148 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-41716970-848a-47af-887f-c30de4ebf18e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:05.281295 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-41716970-848a-47af-887f-c30de4ebf18e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:05.282036 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-41716970-848a-47af-887f-c30de4ebf18e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:05.282727 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-41716970-848a-47af-887f-c30de4ebf18e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:05.445839 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-41716970-848a-47af-887f-c30de4ebf18e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:05.462001 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-41716970-848a-47af-887f-c30de4ebf18e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1444 microversion: 2.1 time: 0.193747 Sep 02 05:26:05.462653 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 268/542] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:05 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1444 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:05.487930 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-dbb99e85-7255-48a6-96b0-95e1d00b42ee tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:05.489270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-dbb99e85-7255-48a6-96b0-95e1d00b42ee tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:05.501997 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dbb99e85-7255-48a6-96b0-95e1d00b42ee tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:05.504253 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dbb99e85-7255-48a6-96b0-95e1d00b42ee tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:05.506640 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dbb99e85-7255-48a6-96b0-95e1d00b42ee tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:05.507594 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dbb99e85-7255-48a6-96b0-95e1d00b42ee tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:05.508673 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dbb99e85-7255-48a6-96b0-95e1d00b42ee tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:05.514418 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dbb99e85-7255-48a6-96b0-95e1d00b42ee tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:05.728532 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-6ecea63f-97b6-4eac-a043-f753fddd0ec4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:05.729544 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-6ecea63f-97b6-4eac-a043-f753fddd0ec4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:05.735968 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6ecea63f-97b6-4eac-a043-f753fddd0ec4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:05.736849 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6ecea63f-97b6-4eac-a043-f753fddd0ec4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:05.737359 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6ecea63f-97b6-4eac-a043-f753fddd0ec4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:05.738135 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6ecea63f-97b6-4eac-a043-f753fddd0ec4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:05.738642 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6ecea63f-97b6-4eac-a043-f753fddd0ec4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:05.739307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6ecea63f-97b6-4eac-a043-f753fddd0ec4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:05.781612 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-dbb99e85-7255-48a6-96b0-95e1d00b42ee tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:05.792732 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-dbb99e85-7255-48a6-96b0-95e1d00b42ee tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1444 microversion: 2.1 time: 0.308710 Sep 02 05:26:05.798361 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 275/543] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:05 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1444 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:06.264308 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-6ecea63f-97b6-4eac-a043-f753fddd0ec4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:06.273846 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-6ecea63f-97b6-4eac-a043-f753fddd0ec4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1372 microversion: 2.1 time: 0.549210 Sep 02 05:26:06.278331 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 269/544] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:05 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1372 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:07.294506 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-e93a3e5c-9a39-4a8f-b111-6c933fad8aad tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:07.295244 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-e93a3e5c-9a39-4a8f-b111-6c933fad8aad tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:07.301338 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e93a3e5c-9a39-4a8f-b111-6c933fad8aad tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:07.301991 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e93a3e5c-9a39-4a8f-b111-6c933fad8aad tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:07.302585 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e93a3e5c-9a39-4a8f-b111-6c933fad8aad tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:07.303444 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e93a3e5c-9a39-4a8f-b111-6c933fad8aad tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:07.304047 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e93a3e5c-9a39-4a8f-b111-6c933fad8aad tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:07.304662 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e93a3e5c-9a39-4a8f-b111-6c933fad8aad tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:07.486104 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e93a3e5c-9a39-4a8f-b111-6c933fad8aad tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:07.494857 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-e93a3e5c-9a39-4a8f-b111-6c933fad8aad tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1372 microversion: 2.1 time: 0.203690 Sep 02 05:26:07.495555 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 276/545] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:07 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1372 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:08.011919 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-7509c8d8-2a2b-483e-9f80-cd018475086a req-7c98057a-d640-40a0-b221-09edd5f20aba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9feba72e-7abe-4be7-b75e-51262eb201a1", "tag": "efc651b2-eb48-40f2-aa6e-8bca71be2b42"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:26:08.022405 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-7509c8d8-2a2b-483e-9f80-cd018475086a req-7c98057a-d640-40a0-b221-09edd5f20aba service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:08.022909 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-7509c8d8-2a2b-483e-9f80-cd018475086a req-7c98057a-d640-40a0-b221-09edd5f20aba service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:08.023284 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-7509c8d8-2a2b-483e-9f80-cd018475086a req-7c98057a-d640-40a0-b221-09edd5f20aba service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:08.035906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-7509c8d8-2a2b-483e-9f80-cd018475086a req-7c98057a-d640-40a0-b221-09edd5f20aba service nova] Creating event network-changed:efc651b2-eb48-40f2-aa6e-8bca71be2b42 for instance 9feba72e-7abe-4be7-b75e-51262eb201a1 on hv-cinder-85391 Sep 02 05:26:08.045323 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-7509c8d8-2a2b-483e-9f80-cd018475086a req-7c98057a-d640-40a0-b221-09edd5f20aba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036962 Sep 02 05:26:08.046191 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 270/546] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:26:08.515873 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-563fdee0-3a3c-4e4a-838e-efcfeaf4cdda tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:08.516825 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-563fdee0-3a3c-4e4a-838e-efcfeaf4cdda tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:08.523540 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-563fdee0-3a3c-4e4a-838e-efcfeaf4cdda tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:08.524097 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-563fdee0-3a3c-4e4a-838e-efcfeaf4cdda tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:08.524695 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-563fdee0-3a3c-4e4a-838e-efcfeaf4cdda tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:08.525362 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-563fdee0-3a3c-4e4a-838e-efcfeaf4cdda tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:08.525811 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-563fdee0-3a3c-4e4a-838e-efcfeaf4cdda tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:08.526235 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-563fdee0-3a3c-4e4a-838e-efcfeaf4cdda tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:08.653742 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-563fdee0-3a3c-4e4a-838e-efcfeaf4cdda tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:08.661709 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-563fdee0-3a3c-4e4a-838e-efcfeaf4cdda tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1372 microversion: 2.1 time: 0.150043 Sep 02 05:26:08.662291 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 277/547] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:08 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:09.681853 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell0:SELECT=2 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:26:09.683039 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell0:SELECT=6 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:26:09.690872 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-a834315f-943d-49b5-9c09-e4888afe10ab tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:09.692003 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-a834315f-943d-49b5-9c09-e4888afe10ab tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:09.701182 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a834315f-943d-49b5-9c09-e4888afe10ab tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:09.701390 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a834315f-943d-49b5-9c09-e4888afe10ab tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:09.701797 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a834315f-943d-49b5-9c09-e4888afe10ab tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:09.702511 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a834315f-943d-49b5-9c09-e4888afe10ab tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:09.702961 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a834315f-943d-49b5-9c09-e4888afe10ab tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:09.703388 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a834315f-943d-49b5-9c09-e4888afe10ab tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:09.847262 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-a834315f-943d-49b5-9c09-e4888afe10ab tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:09.855288 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-a834315f-943d-49b5-9c09-e4888afe10ab tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1372 microversion: 2.1 time: 0.175211 Sep 02 05:26:09.855883 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 271/548] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:09 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:10.884572 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-33fcca49-65f7-4b8f-b1fd-1786844f0ac0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:10.885557 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-33fcca49-65f7-4b8f-b1fd-1786844f0ac0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:10.888574 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell0:SELECT=6 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:26:10.897635 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-33fcca49-65f7-4b8f-b1fd-1786844f0ac0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:10.898405 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-33fcca49-65f7-4b8f-b1fd-1786844f0ac0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:10.899269 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-33fcca49-65f7-4b8f-b1fd-1786844f0ac0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:10.899947 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-33fcca49-65f7-4b8f-b1fd-1786844f0ac0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:10.900420 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-33fcca49-65f7-4b8f-b1fd-1786844f0ac0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:10.900835 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-33fcca49-65f7-4b8f-b1fd-1786844f0ac0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:11.032784 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-33fcca49-65f7-4b8f-b1fd-1786844f0ac0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:11.041372 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-33fcca49-65f7-4b8f-b1fd-1786844f0ac0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1372 microversion: 2.1 time: 0.163436 Sep 02 05:26:11.041947 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 278/549] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:10 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:12.063032 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-170c233d-c0d1-4496-ac44-47f614699df6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:12.063674 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-170c233d-c0d1-4496-ac44-47f614699df6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:12.070263 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-170c233d-c0d1-4496-ac44-47f614699df6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:12.070746 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-170c233d-c0d1-4496-ac44-47f614699df6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:12.071203 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-170c233d-c0d1-4496-ac44-47f614699df6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:12.071831 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-170c233d-c0d1-4496-ac44-47f614699df6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:12.072352 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-170c233d-c0d1-4496-ac44-47f614699df6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:12.072772 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-170c233d-c0d1-4496-ac44-47f614699df6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:12.206986 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-170c233d-c0d1-4496-ac44-47f614699df6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:12.216640 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-170c233d-c0d1-4496-ac44-47f614699df6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1372 microversion: 2.1 time: 0.157436 Sep 02 05:26:12.217230 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 272/550] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:12 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:13.237392 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-e2e12af1-4a94-4b78-b375-e307fb7cd822 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:13.237945 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-e2e12af1-4a94-4b78-b375-e307fb7cd822 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:13.244874 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e2e12af1-4a94-4b78-b375-e307fb7cd822 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:13.245331 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e2e12af1-4a94-4b78-b375-e307fb7cd822 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:13.245791 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e2e12af1-4a94-4b78-b375-e307fb7cd822 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:13.246484 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e2e12af1-4a94-4b78-b375-e307fb7cd822 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:13.246942 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e2e12af1-4a94-4b78-b375-e307fb7cd822 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:13.247364 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e2e12af1-4a94-4b78-b375-e307fb7cd822 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:13.403326 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e2e12af1-4a94-4b78-b375-e307fb7cd822 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:13.411189 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-e2e12af1-4a94-4b78-b375-e307fb7cd822 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1372 microversion: 2.1 time: 0.177730 Sep 02 05:26:13.416157 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 279/551] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:13 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1372 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:14.437060 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f9fb67a3-19dc-4ae8-bf68-c97c6eca47a0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:14.437668 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f9fb67a3-19dc-4ae8-bf68-c97c6eca47a0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:14.446489 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f9fb67a3-19dc-4ae8-bf68-c97c6eca47a0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:14.446949 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f9fb67a3-19dc-4ae8-bf68-c97c6eca47a0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:14.447443 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f9fb67a3-19dc-4ae8-bf68-c97c6eca47a0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:14.448270 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f9fb67a3-19dc-4ae8-bf68-c97c6eca47a0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:14.448772 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f9fb67a3-19dc-4ae8-bf68-c97c6eca47a0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:14.449171 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f9fb67a3-19dc-4ae8-bf68-c97c6eca47a0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:14.587706 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f9fb67a3-19dc-4ae8-bf68-c97c6eca47a0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:14.595303 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f9fb67a3-19dc-4ae8-bf68-c97c6eca47a0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1372 microversion: 2.1 time: 0.162192 Sep 02 05:26:14.595871 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 273/552] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:14 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:15.627347 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-a6510bc8-dd5b-4a47-a11b-71d1de156df8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:15.628390 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-a6510bc8-dd5b-4a47-a11b-71d1de156df8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:15.637726 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a6510bc8-dd5b-4a47-a11b-71d1de156df8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:15.638214 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a6510bc8-dd5b-4a47-a11b-71d1de156df8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:15.638646 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a6510bc8-dd5b-4a47-a11b-71d1de156df8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:15.639403 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a6510bc8-dd5b-4a47-a11b-71d1de156df8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:15.639775 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a6510bc8-dd5b-4a47-a11b-71d1de156df8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:15.640219 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a6510bc8-dd5b-4a47-a11b-71d1de156df8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:15.644391 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=100 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:26:15.777303 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-a6510bc8-dd5b-4a47-a11b-71d1de156df8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:15.785411 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-a6510bc8-dd5b-4a47-a11b-71d1de156df8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1372 microversion: 2.1 time: 0.164690 Sep 02 05:26:15.785974 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 280/553] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:15 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:16.805976 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f28147bc-7daf-4b47-845c-42c5b400af45 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:16.806544 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f28147bc-7daf-4b47-845c-42c5b400af45 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:16.813470 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f28147bc-7daf-4b47-845c-42c5b400af45 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:16.813946 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f28147bc-7daf-4b47-845c-42c5b400af45 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:16.814371 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f28147bc-7daf-4b47-845c-42c5b400af45 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:16.815078 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f28147bc-7daf-4b47-845c-42c5b400af45 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:16.815534 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f28147bc-7daf-4b47-845c-42c5b400af45 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:16.815949 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f28147bc-7daf-4b47-845c-42c5b400af45 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:16.964607 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f28147bc-7daf-4b47-845c-42c5b400af45 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:16.974707 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f28147bc-7daf-4b47-845c-42c5b400af45 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1372 microversion: 2.1 time: 0.172365 Sep 02 05:26:16.975426 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 274/554] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:16 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:17.999698 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-3ce9d319-6bf5-4821-913b-d59d222b88f3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:18.000794 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-3ce9d319-6bf5-4821-913b-d59d222b88f3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:18.010994 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3ce9d319-6bf5-4821-913b-d59d222b88f3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:18.011798 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3ce9d319-6bf5-4821-913b-d59d222b88f3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:18.012710 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3ce9d319-6bf5-4821-913b-d59d222b88f3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:18.013410 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3ce9d319-6bf5-4821-913b-d59d222b88f3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:18.013868 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3ce9d319-6bf5-4821-913b-d59d222b88f3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:18.014292 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3ce9d319-6bf5-4821-913b-d59d222b88f3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:18.160565 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-3ce9d319-6bf5-4821-913b-d59d222b88f3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:18.168952 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-3ce9d319-6bf5-4821-913b-d59d222b88f3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1372 microversion: 2.1 time: 0.175958 Sep 02 05:26:18.169584 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 281/555] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:17 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:19.197715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-22135e5c-2624-4bc4-8394-e60e3aa58543 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:19.198657 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-22135e5c-2624-4bc4-8394-e60e3aa58543 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:19.207065 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-22135e5c-2624-4bc4-8394-e60e3aa58543 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:19.207535 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-22135e5c-2624-4bc4-8394-e60e3aa58543 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:19.207962 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-22135e5c-2624-4bc4-8394-e60e3aa58543 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:19.208688 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-22135e5c-2624-4bc4-8394-e60e3aa58543 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:19.209143 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-22135e5c-2624-4bc4-8394-e60e3aa58543 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:19.209563 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-22135e5c-2624-4bc4-8394-e60e3aa58543 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:19.339113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-22135e5c-2624-4bc4-8394-e60e3aa58543 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:19.347071 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-22135e5c-2624-4bc4-8394-e60e3aa58543 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1372 microversion: 2.1 time: 0.155853 Sep 02 05:26:19.347629 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 275/556] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:19 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:20.371666 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-f94bcda9-72c4-4a7d-bf5c-997db4c603db tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:20.372631 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-f94bcda9-72c4-4a7d-bf5c-997db4c603db tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:20.374512 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:26:20.380015 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f94bcda9-72c4-4a7d-bf5c-997db4c603db tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:20.380525 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f94bcda9-72c4-4a7d-bf5c-997db4c603db tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:20.380953 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f94bcda9-72c4-4a7d-bf5c-997db4c603db tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:20.381627 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f94bcda9-72c4-4a7d-bf5c-997db4c603db tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:20.382074 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f94bcda9-72c4-4a7d-bf5c-997db4c603db tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:20.382492 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f94bcda9-72c4-4a7d-bf5c-997db4c603db tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:20.523517 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-f94bcda9-72c4-4a7d-bf5c-997db4c603db tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:20.533237 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-f94bcda9-72c4-4a7d-bf5c-997db4c603db tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1372 microversion: 2.1 time: 0.168293 Sep 02 05:26:20.533803 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 282/557] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:20 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:21.554161 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-a92c0df8-321e-46d1-a4ae-d9b42b761e07 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:21.554772 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-a92c0df8-321e-46d1-a4ae-d9b42b761e07 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:21.561744 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a92c0df8-321e-46d1-a4ae-d9b42b761e07 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:21.562230 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a92c0df8-321e-46d1-a4ae-d9b42b761e07 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:21.562664 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a92c0df8-321e-46d1-a4ae-d9b42b761e07 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:21.563328 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a92c0df8-321e-46d1-a4ae-d9b42b761e07 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:21.563800 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a92c0df8-321e-46d1-a4ae-d9b42b761e07 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:21.564258 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a92c0df8-321e-46d1-a4ae-d9b42b761e07 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:21.583201 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:26:21.699620 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-a92c0df8-321e-46d1-a4ae-d9b42b761e07 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:21.708466 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-a92c0df8-321e-46d1-a4ae-d9b42b761e07 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1372 microversion: 2.1 time: 0.158154 Sep 02 05:26:21.710831 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 276/558] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:21 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:22.731430 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-e2b70b21-bc28-4ac9-ae59-3a0323f45c4e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:22.732077 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-e2b70b21-bc28-4ac9-ae59-3a0323f45c4e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:22.739880 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e2b70b21-bc28-4ac9-ae59-3a0323f45c4e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:22.740402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e2b70b21-bc28-4ac9-ae59-3a0323f45c4e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:22.740836 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e2b70b21-bc28-4ac9-ae59-3a0323f45c4e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:22.741617 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e2b70b21-bc28-4ac9-ae59-3a0323f45c4e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:22.742541 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e2b70b21-bc28-4ac9-ae59-3a0323f45c4e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:22.743124 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e2b70b21-bc28-4ac9-ae59-3a0323f45c4e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:23.214860 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e2b70b21-bc28-4ac9-ae59-3a0323f45c4e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:23.223332 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-e2b70b21-bc28-4ac9-ae59-3a0323f45c4e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1372 microversion: 2.1 time: 0.496088 Sep 02 05:26:23.224931 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 283/559] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:22 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1372 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:24.245462 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-146099e5-18d8-4da3-99a8-72982b627db2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:24.246066 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-146099e5-18d8-4da3-99a8-72982b627db2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:24.254574 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-146099e5-18d8-4da3-99a8-72982b627db2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:24.255233 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-146099e5-18d8-4da3-99a8-72982b627db2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:24.255739 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-146099e5-18d8-4da3-99a8-72982b627db2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:24.256836 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-146099e5-18d8-4da3-99a8-72982b627db2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:24.257445 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-146099e5-18d8-4da3-99a8-72982b627db2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:24.258025 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-146099e5-18d8-4da3-99a8-72982b627db2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:24.398676 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-146099e5-18d8-4da3-99a8-72982b627db2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:24.411221 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-146099e5-18d8-4da3-99a8-72982b627db2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1372 microversion: 2.1 time: 0.169601 Sep 02 05:26:24.412023 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 277/560] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:24 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:25.436511 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-fef2a0e1-ed48-4320-b4dc-4a5a7fc2068c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:25.437479 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-fef2a0e1-ed48-4320-b4dc-4a5a7fc2068c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:25.447569 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fef2a0e1-ed48-4320-b4dc-4a5a7fc2068c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:25.448416 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fef2a0e1-ed48-4320-b4dc-4a5a7fc2068c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:25.449143 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fef2a0e1-ed48-4320-b4dc-4a5a7fc2068c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:25.450251 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fef2a0e1-ed48-4320-b4dc-4a5a7fc2068c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:25.451097 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fef2a0e1-ed48-4320-b4dc-4a5a7fc2068c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:25.451543 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fef2a0e1-ed48-4320-b4dc-4a5a7fc2068c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:25.585295 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-fef2a0e1-ed48-4320-b4dc-4a5a7fc2068c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:25.593402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-fef2a0e1-ed48-4320-b4dc-4a5a7fc2068c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1372 microversion: 2.1 time: 0.163440 Sep 02 05:26:25.593975 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 284/561] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:25 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:26.619776 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-b640726d-a0a0-4528-974e-0fc8d78c29c5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:26.621179 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-b640726d-a0a0-4528-974e-0fc8d78c29c5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:26.632521 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b640726d-a0a0-4528-974e-0fc8d78c29c5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:26.633327 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b640726d-a0a0-4528-974e-0fc8d78c29c5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:26.634088 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b640726d-a0a0-4528-974e-0fc8d78c29c5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:26.635183 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b640726d-a0a0-4528-974e-0fc8d78c29c5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:26.635947 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b640726d-a0a0-4528-974e-0fc8d78c29c5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:26.636714 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b640726d-a0a0-4528-974e-0fc8d78c29c5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:26.767828 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-b640726d-a0a0-4528-974e-0fc8d78c29c5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:26.779305 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-b640726d-a0a0-4528-974e-0fc8d78c29c5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1372 microversion: 2.1 time: 0.167547 Sep 02 05:26:26.780144 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 278/562] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:26 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:27.804776 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-0762486f-feeb-48d4-b82c-b3e1c5c65eaf tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:27.805331 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-0762486f-feeb-48d4-b82c-b3e1c5c65eaf tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:27.811792 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0762486f-feeb-48d4-b82c-b3e1c5c65eaf tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:27.812300 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0762486f-feeb-48d4-b82c-b3e1c5c65eaf tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:27.812726 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0762486f-feeb-48d4-b82c-b3e1c5c65eaf tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:27.813407 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0762486f-feeb-48d4-b82c-b3e1c5c65eaf tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:27.813847 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0762486f-feeb-48d4-b82c-b3e1c5c65eaf tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:27.814260 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0762486f-feeb-48d4-b82c-b3e1c5c65eaf tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:27.950900 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-0762486f-feeb-48d4-b82c-b3e1c5c65eaf tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:27.962687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-0762486f-feeb-48d4-b82c-b3e1c5c65eaf tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1372 microversion: 2.1 time: 0.161730 Sep 02 05:26:27.963406 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 285/563] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:27 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:28.988064 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-79f69a1c-03a2-404c-8db3-6af9e84138ac tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:28.988986 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-79f69a1c-03a2-404c-8db3-6af9e84138ac tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:28.992898 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:26:29.001249 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-79f69a1c-03a2-404c-8db3-6af9e84138ac tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:29.002042 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-79f69a1c-03a2-404c-8db3-6af9e84138ac tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:29.002746 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-79f69a1c-03a2-404c-8db3-6af9e84138ac tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:29.003857 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-79f69a1c-03a2-404c-8db3-6af9e84138ac tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:29.004748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-79f69a1c-03a2-404c-8db3-6af9e84138ac tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:29.005446 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-79f69a1c-03a2-404c-8db3-6af9e84138ac tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:29.144660 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-79f69a1c-03a2-404c-8db3-6af9e84138ac tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:29.164092 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-79f69a1c-03a2-404c-8db3-6af9e84138ac tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1372 microversion: 2.1 time: 0.182231 Sep 02 05:26:29.164940 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 279/564] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:28 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1372 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:30.188593 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-e6d7d651-417d-423f-96e1-4accb3ffa162 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:30.189340 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-e6d7d651-417d-423f-96e1-4accb3ffa162 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:30.197072 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e6d7d651-417d-423f-96e1-4accb3ffa162 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:30.197683 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e6d7d651-417d-423f-96e1-4accb3ffa162 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:30.198225 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e6d7d651-417d-423f-96e1-4accb3ffa162 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:30.199080 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e6d7d651-417d-423f-96e1-4accb3ffa162 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:30.199644 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e6d7d651-417d-423f-96e1-4accb3ffa162 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:30.200186 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e6d7d651-417d-423f-96e1-4accb3ffa162 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:30.337713 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e6d7d651-417d-423f-96e1-4accb3ffa162 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:30.345502 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-e6d7d651-417d-423f-96e1-4accb3ffa162 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1372 microversion: 2.1 time: 0.162405 Sep 02 05:26:30.346100 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 286/565] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:30 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:31.369752 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-2179fdf0-0496-40df-81ca-7db30bf9769b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:31.370637 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-2179fdf0-0496-40df-81ca-7db30bf9769b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:31.382026 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2179fdf0-0496-40df-81ca-7db30bf9769b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:31.382817 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2179fdf0-0496-40df-81ca-7db30bf9769b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:31.383533 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2179fdf0-0496-40df-81ca-7db30bf9769b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:31.384714 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2179fdf0-0496-40df-81ca-7db30bf9769b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:31.385471 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2179fdf0-0496-40df-81ca-7db30bf9769b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:31.386209 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2179fdf0-0496-40df-81ca-7db30bf9769b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:31.520774 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-2179fdf0-0496-40df-81ca-7db30bf9769b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:31.528631 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-2179fdf0-0496-40df-81ca-7db30bf9769b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1372 microversion: 2.1 time: 0.165782 Sep 02 05:26:31.529312 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 280/566] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:31 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:31.613794 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-321c7aeb-93c9-43e1-89a0-9e5e1dcce60e req-30544bd2-51e7-456b-b9ed-29ed65e2c4d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc1683c4-1646-485d-99de-4b1591af0455", "name": "network-vif-plugged", "status": "completed", "tag": "9b093d1d-f4c7-44e9-a59c-36fc5dbe9a0a"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:26:31.624753 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-321c7aeb-93c9-43e1-89a0-9e5e1dcce60e req-30544bd2-51e7-456b-b9ed-29ed65e2c4d6 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:31.625228 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-321c7aeb-93c9-43e1-89a0-9e5e1dcce60e req-30544bd2-51e7-456b-b9ed-29ed65e2c4d6 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:31.625788 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-321c7aeb-93c9-43e1-89a0-9e5e1dcce60e req-30544bd2-51e7-456b-b9ed-29ed65e2c4d6 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:31.638709 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-321c7aeb-93c9-43e1-89a0-9e5e1dcce60e req-30544bd2-51e7-456b-b9ed-29ed65e2c4d6 service nova] Creating event network-vif-plugged:9b093d1d-f4c7-44e9-a59c-36fc5dbe9a0a for instance dc1683c4-1646-485d-99de-4b1591af0455 on hv-cinder-85391 Sep 02 05:26:31.644365 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-321c7aeb-93c9-43e1-89a0-9e5e1dcce60e req-30544bd2-51e7-456b-b9ed-29ed65e2c4d6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034328 Sep 02 05:26:31.644935 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 287/567] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:26:32.553650 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-fd45b364-5a76-4fe1-8abf-f2e188d2aec6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:32.554659 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-fd45b364-5a76-4fe1-8abf-f2e188d2aec6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:32.565790 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fd45b364-5a76-4fe1-8abf-f2e188d2aec6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:32.566534 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fd45b364-5a76-4fe1-8abf-f2e188d2aec6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:32.567267 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fd45b364-5a76-4fe1-8abf-f2e188d2aec6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:32.568463 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fd45b364-5a76-4fe1-8abf-f2e188d2aec6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:32.569220 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fd45b364-5a76-4fe1-8abf-f2e188d2aec6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:32.569921 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fd45b364-5a76-4fe1-8abf-f2e188d2aec6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:32.722144 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-fd45b364-5a76-4fe1-8abf-f2e188d2aec6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:32.730517 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-fd45b364-5a76-4fe1-8abf-f2e188d2aec6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1372 microversion: 2.1 time: 0.183328 Sep 02 05:26:32.731085 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 281/568] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:32 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1372 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:33.751614 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-71b1bcac-c690-4fcb-bbf4-4d4f34c6ada4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:33.752392 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-71b1bcac-c690-4fcb-bbf4-4d4f34c6ada4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:33.759073 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-71b1bcac-c690-4fcb-bbf4-4d4f34c6ada4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:33.759526 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-71b1bcac-c690-4fcb-bbf4-4d4f34c6ada4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:33.759952 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-71b1bcac-c690-4fcb-bbf4-4d4f34c6ada4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:33.760671 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-71b1bcac-c690-4fcb-bbf4-4d4f34c6ada4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:33.761113 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-71b1bcac-c690-4fcb-bbf4-4d4f34c6ada4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:33.761528 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-71b1bcac-c690-4fcb-bbf4-4d4f34c6ada4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:33.905904 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-71b1bcac-c690-4fcb-bbf4-4d4f34c6ada4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:33.913897 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-71b1bcac-c690-4fcb-bbf4-4d4f34c6ada4 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1372 microversion: 2.1 time: 0.166595 Sep 02 05:26:33.914760 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 288/569] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:33 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:34.936650 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-3647724d-055e-4e00-9d80-847ae12b870b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:34.937338 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-3647724d-055e-4e00-9d80-847ae12b870b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:34.944236 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3647724d-055e-4e00-9d80-847ae12b870b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:34.944718 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3647724d-055e-4e00-9d80-847ae12b870b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:34.945146 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3647724d-055e-4e00-9d80-847ae12b870b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:34.945829 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3647724d-055e-4e00-9d80-847ae12b870b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:34.946321 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3647724d-055e-4e00-9d80-847ae12b870b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:34.946743 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3647724d-055e-4e00-9d80-847ae12b870b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:35.085039 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-3647724d-055e-4e00-9d80-847ae12b870b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:35.093088 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-3647724d-055e-4e00-9d80-847ae12b870b tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1566 microversion: 2.1 time: 0.161554 Sep 02 05:26:35.093664 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 282/570] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:34 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:35.113601 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-b9ef51c0-6fec-4e58-bd69-2a4e75309391 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:35.114124 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-b9ef51c0-6fec-4e58-bd69-2a4e75309391 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:35.120570 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b9ef51c0-6fec-4e58-bd69-2a4e75309391 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:35.121051 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b9ef51c0-6fec-4e58-bd69-2a4e75309391 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:35.121489 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b9ef51c0-6fec-4e58-bd69-2a4e75309391 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:35.122165 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b9ef51c0-6fec-4e58-bd69-2a4e75309391 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:35.122685 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b9ef51c0-6fec-4e58-bd69-2a4e75309391 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:35.123107 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b9ef51c0-6fec-4e58-bd69-2a4e75309391 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:35.206622 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-b9ef51c0-6fec-4e58-bd69-2a4e75309391 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096254 Sep 02 05:26:35.207625 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 289/571] 10.222.0.30 () {58 vars in 1275 bytes} [Fri Sep 2 05:26:35 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 05:26:35.506787 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-2588ea7b-d695-4b61-98d8-ffd96b4bbaa9 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:35.507246 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-2588ea7b-d695-4b61-98d8-ffd96b4bbaa9 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:35.513723 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2588ea7b-d695-4b61-98d8-ffd96b4bbaa9 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:35.514296 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2588ea7b-d695-4b61-98d8-ffd96b4bbaa9 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:35.514767 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2588ea7b-d695-4b61-98d8-ffd96b4bbaa9 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:35.515484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2588ea7b-d695-4b61-98d8-ffd96b4bbaa9 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:35.515940 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2588ea7b-d695-4b61-98d8-ffd96b4bbaa9 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:35.517076 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2588ea7b-d695-4b61-98d8-ffd96b4bbaa9 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:35.666662 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.objects.instance [None req-2588ea7b-d695-4b61-98d8-ffd96b4bbaa9 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lazy-loading 'services' on Instance uuid a5611a5c-47c5-4f55-95d0-4c54b5af318b {{(pid=120448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:26:35.802675 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-2588ea7b-d695-4b61-98d8-ffd96b4bbaa9 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b/os-volume_attachments/e64c8f05-1e14-45ff-8d20-8e015e029ecf" status: 202 len: 0 microversion: 2.1 time: 0.299596 Sep 02 05:26:35.806672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 283/572] 10.222.0.30 () {58 vars in 1416 bytes} [Fri Sep 2 05:26:35 2022] DELETE /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b/os-volume_attachments/e64c8f05-1e14-45ff-8d20-8e015e029ecf => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:26:36.197638 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-fae71153-23d3-4f9c-bd57-977753dc576e req-8060d1d3-c879-4a10-9bd5-af728288c3e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc1683c4-1646-485d-99de-4b1591af0455", "tag": "9b093d1d-f4c7-44e9-a59c-36fc5dbe9a0a"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:26:36.208053 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-fae71153-23d3-4f9c-bd57-977753dc576e req-8060d1d3-c879-4a10-9bd5-af728288c3e0 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:36.208540 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-fae71153-23d3-4f9c-bd57-977753dc576e req-8060d1d3-c879-4a10-9bd5-af728288c3e0 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:36.208965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-fae71153-23d3-4f9c-bd57-977753dc576e req-8060d1d3-c879-4a10-9bd5-af728288c3e0 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:36.219925 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-fae71153-23d3-4f9c-bd57-977753dc576e req-8060d1d3-c879-4a10-9bd5-af728288c3e0 service nova] Creating event network-changed:9b093d1d-f4c7-44e9-a59c-36fc5dbe9a0a for instance dc1683c4-1646-485d-99de-4b1591af0455 on hv-cinder-85391 Sep 02 05:26:36.224945 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-fae71153-23d3-4f9c-bd57-977753dc576e req-8060d1d3-c879-4a10-9bd5-af728288c3e0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031045 Sep 02 05:26:36.225542 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 290/573] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:26:38.024435 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-05f89ec6-0df6-4891-9198-50eb91b19014 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:38.025007 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-05f89ec6-0df6-4891-9198-50eb91b19014 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:38.034872 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-05f89ec6-0df6-4891-9198-50eb91b19014 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:38.035566 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-05f89ec6-0df6-4891-9198-50eb91b19014 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:38.036187 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-05f89ec6-0df6-4891-9198-50eb91b19014 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:38.037239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-05f89ec6-0df6-4891-9198-50eb91b19014 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:38.037949 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-05f89ec6-0df6-4891-9198-50eb91b19014 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:38.038535 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-05f89ec6-0df6-4891-9198-50eb91b19014 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:38.068149 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-05f89ec6-0df6-4891-9198-50eb91b19014 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] Going to try to terminate instance {{(pid=120448) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 05:26:38.151534 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-05f89ec6-0df6-4891-9198-50eb91b19014 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b" status: 204 len: 0 microversion: 2.1 time: 0.134429 Sep 02 05:26:38.152157 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 284/574] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Sep 2 05:26:38 2022] DELETE /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 05:26:38.161512 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-67ea0bdd-9d01-42f9-bf82-a1cc0cafe07c tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:38.162923 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-67ea0bdd-9d01-42f9-bf82-a1cc0cafe07c tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:38.165473 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 05:26:38.165621 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Fri Sep 2 05:26:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b (ip 10.222.0.30) !!! Sep 02 05:26:38.173002 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-67ea0bdd-9d01-42f9-bf82-a1cc0cafe07c tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:38.173483 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-67ea0bdd-9d01-42f9-bf82-a1cc0cafe07c tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:38.173921 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-67ea0bdd-9d01-42f9-bf82-a1cc0cafe07c tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:38.174616 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-67ea0bdd-9d01-42f9-bf82-a1cc0cafe07c tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:38.175073 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-67ea0bdd-9d01-42f9-bf82-a1cc0cafe07c tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:38.175494 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-67ea0bdd-9d01-42f9-bf82-a1cc0cafe07c tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:38.308738 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-67ea0bdd-9d01-42f9-bf82-a1cc0cafe07c tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:38.316992 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-67ea0bdd-9d01-42f9-bf82-a1cc0cafe07c tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b" status: 200 len: 1511 microversion: 2.1 time: 0.160181 Sep 02 05:26:38.317537 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 291/575] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:38 2022] GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:39.343029 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d3be2e74-7b9a-4b10-bd25-748fa246196f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:39.344224 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-d3be2e74-7b9a-4b10-bd25-748fa246196f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:39.354967 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d3be2e74-7b9a-4b10-bd25-748fa246196f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:39.355835 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d3be2e74-7b9a-4b10-bd25-748fa246196f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:39.356655 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d3be2e74-7b9a-4b10-bd25-748fa246196f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:39.357781 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d3be2e74-7b9a-4b10-bd25-748fa246196f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:39.358527 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d3be2e74-7b9a-4b10-bd25-748fa246196f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:39.359241 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d3be2e74-7b9a-4b10-bd25-748fa246196f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:39.517291 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d3be2e74-7b9a-4b10-bd25-748fa246196f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:39.527558 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-d3be2e74-7b9a-4b10-bd25-748fa246196f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b" status: 200 len: 1511 microversion: 2.1 time: 0.191574 Sep 02 05:26:39.528111 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 285/576] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:39 2022] GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b => generated 1511 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:40.558522 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-fd27f4e4-5930-41b9-b63c-c1a05bb8f4f7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:40.559408 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-fd27f4e4-5930-41b9-b63c-c1a05bb8f4f7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:40.570216 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fd27f4e4-5930-41b9-b63c-c1a05bb8f4f7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:40.571004 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fd27f4e4-5930-41b9-b63c-c1a05bb8f4f7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:40.571760 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fd27f4e4-5930-41b9-b63c-c1a05bb8f4f7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:40.572987 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fd27f4e4-5930-41b9-b63c-c1a05bb8f4f7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:40.573745 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fd27f4e4-5930-41b9-b63c-c1a05bb8f4f7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:40.574488 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fd27f4e4-5930-41b9-b63c-c1a05bb8f4f7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:40.719722 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-fd27f4e4-5930-41b9-b63c-c1a05bb8f4f7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:40.727678 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-fd27f4e4-5930-41b9-b63c-c1a05bb8f4f7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b" status: 200 len: 1511 microversion: 2.1 time: 0.176254 Sep 02 05:26:40.728281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 292/577] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:40 2022] GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:41.748741 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-031e8229-a0b7-4dc5-892c-4ae51ab3953a tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:41.750033 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-031e8229-a0b7-4dc5-892c-4ae51ab3953a tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:41.757084 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-031e8229-a0b7-4dc5-892c-4ae51ab3953a tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:41.757900 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-031e8229-a0b7-4dc5-892c-4ae51ab3953a tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:41.758327 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-031e8229-a0b7-4dc5-892c-4ae51ab3953a tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:41.758993 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-031e8229-a0b7-4dc5-892c-4ae51ab3953a tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:41.759842 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-031e8229-a0b7-4dc5-892c-4ae51ab3953a tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:41.760379 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-031e8229-a0b7-4dc5-892c-4ae51ab3953a tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:42.051770 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-031e8229-a0b7-4dc5-892c-4ae51ab3953a tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:42.059855 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-031e8229-a0b7-4dc5-892c-4ae51ab3953a tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b" status: 200 len: 1511 microversion: 2.1 time: 0.315080 Sep 02 05:26:42.060785 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 286/578] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:41 2022] GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b => generated 1511 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:42.101349 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-8c40b7f0-334b-45e0-9131-33b9b3b999da req-f12ef085-6955-4042-830f-904b5b58abe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5611a5c-47c5-4f55-95d0-4c54b5af318b", "name": "network-vif-deleted", "tag": "b873aab3-035f-4e63-a1ab-29afdf7c6570"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:26:42.111136 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-8c40b7f0-334b-45e0-9131-33b9b3b999da req-f12ef085-6955-4042-830f-904b5b58abe7 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:42.111650 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-8c40b7f0-334b-45e0-9131-33b9b3b999da req-f12ef085-6955-4042-830f-904b5b58abe7 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:42.112079 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-8c40b7f0-334b-45e0-9131-33b9b3b999da req-f12ef085-6955-4042-830f-904b5b58abe7 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:42.123629 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-8c40b7f0-334b-45e0-9131-33b9b3b999da req-f12ef085-6955-4042-830f-904b5b58abe7 service nova] Creating event network-vif-deleted:b873aab3-035f-4e63-a1ab-29afdf7c6570 for instance a5611a5c-47c5-4f55-95d0-4c54b5af318b on hv-cinder-85391 Sep 02 05:26:42.128672 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-8c40b7f0-334b-45e0-9131-33b9b3b999da req-f12ef085-6955-4042-830f-904b5b58abe7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030958 Sep 02 05:26:42.129334 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 293/579] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:26:43.081388 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-6e774eed-61d3-43be-97c7-cf22cc48fc3d tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:43.081998 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-6e774eed-61d3-43be-97c7-cf22cc48fc3d tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:43.089130 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6e774eed-61d3-43be-97c7-cf22cc48fc3d tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:43.089653 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6e774eed-61d3-43be-97c7-cf22cc48fc3d tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:43.090189 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6e774eed-61d3-43be-97c7-cf22cc48fc3d tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:43.090908 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6e774eed-61d3-43be-97c7-cf22cc48fc3d tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:43.091352 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6e774eed-61d3-43be-97c7-cf22cc48fc3d tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:43.091998 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6e774eed-61d3-43be-97c7-cf22cc48fc3d tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:43.140320 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6e774eed-61d3-43be-97c7-cf22cc48fc3d tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:43.140832 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6e774eed-61d3-43be-97c7-cf22cc48fc3d tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:43.141476 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6e774eed-61d3-43be-97c7-cf22cc48fc3d tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:43.142080 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.objects.instance [None req-6e774eed-61d3-43be-97c7-cf22cc48fc3d tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lazy-loading 'fault' on Instance uuid a5611a5c-47c5-4f55-95d0-4c54b5af318b {{(pid=120448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:26:43.193710 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-6e774eed-61d3-43be-97c7-cf22cc48fc3d tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:26:43.201208 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-6e774eed-61d3-43be-97c7-cf22cc48fc3d tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b" status: 200 len: 1307 microversion: 2.1 time: 0.124478 Sep 02 05:26:43.202082 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 287/580] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:43 2022] GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b => generated 1307 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:26:44.228635 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-112f4202-4d7f-4cff-9d8e-1c6989550bc4 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:44.229849 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-112f4202-4d7f-4cff-9d8e-1c6989550bc4 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: a5611a5c-47c5-4f55-95d0-4c54b5af318b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:44.240324 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-112f4202-4d7f-4cff-9d8e-1c6989550bc4 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:44.240836 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-112f4202-4d7f-4cff-9d8e-1c6989550bc4 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:44.241272 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-112f4202-4d7f-4cff-9d8e-1c6989550bc4 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:44.242275 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-112f4202-4d7f-4cff-9d8e-1c6989550bc4 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:44.242726 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-112f4202-4d7f-4cff-9d8e-1c6989550bc4 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:44.243148 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-112f4202-4d7f-4cff-9d8e-1c6989550bc4 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:44.256657 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.wsgi [None req-112f4202-4d7f-4cff-9d8e-1c6989550bc4 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] HTTP exception thrown: Instance a5611a5c-47c5-4f55-95d0-4c54b5af318b could not be found. Sep 02 05:26:44.258289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-112f4202-4d7f-4cff-9d8e-1c6989550bc4 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Request method failure captured: Sep 02 05:26:44.258289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: request: GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b HTTP/1.1 Sep 02 05:26:44.258289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept: application/json Sep 02 05:26:44.258289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept-Encoding: identity Sep 02 05:26:44.258289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Connection: close Sep 02 05:26:44.258289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Length: 0 Sep 02 05:26:44.258289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Type: application/json Sep 02 05:26:44.258289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Host: 10.222.0.30 Sep 02 05:26:44.258289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Openstack-System-Scope: None Sep 02 05:26:44.258289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: User-Agent: python-urllib3/1.26.12 Sep 02 05:26:44.258289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Auth-Token: gAAAAABjEZOtCVhXacz596Ia30eOkgfIIwWVd4kxWqdb_UZVU8ngcQGQr8c7aKyZALfNAO4uMognD1CXQuK7TLSgGmQpxLHlMwsYIITLPEcvX4cHGbLr4b1Xs_HIJ4TvOfC8nmg2qNIhwyABW1AccK5cl4H7NtEDqNKNKeBBslZndFu8IiL4UzQ Sep 02 05:26:44.258289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Id: None Sep 02 05:26:44.258289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Name: None Sep 02 05:26:44.258289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Identity-Status: Confirmed Sep 02 05:26:44.258289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Is-Admin-Project: True Sep 02 05:26:44.258289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Id: default Sep 02 05:26:44.258289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Name: Default Sep 02 05:26:44.258289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Id: a0bc748ee5804c9499d0c0b80e14d711 Sep 02 05:26:44.258289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1789327051 Sep 02 05:26:44.258289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Role: member,reader Sep 02 05:26:44.258289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Roles: member,reader Sep 02 05:26:44.259747 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a0bc748ee5804c9499d0c0b80e14d711"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a0bc748ee5804c9499d0c0b80e14d711"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a0bc748ee5804c9499d0c0b80e14d711"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a0bc748ee5804c9499d0c0b80e14d711"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:26:44.259747 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant: tempest-VolumesSnapshotTestJSON-1789327051 Sep 02 05:26:44.259747 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Id: a0bc748ee5804c9499d0c0b80e14d711 Sep 02 05:26:44.259747 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1789327051 Sep 02 05:26:44.259747 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User: tempest-VolumesSnapshotTestJSON-1789327051-project Sep 02 05:26:44.259747 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Id: default Sep 02 05:26:44.259747 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Name: Default Sep 02 05:26:44.259747 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Id: c5943ce507ca4e67928bc1b98c9e8edb Sep 02 05:26:44.259747 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Name: tempest-VolumesSnapshotTestJSON-1789327051-project Sep 02 05:26:44.259747 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: method: > Sep 02 05:26:44.259747 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: exception: Instance a5611a5c-47c5-4f55-95d0-4c54b5af318b could not be found. Sep 02 05:26:44.259747 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: action_args: {'id': 'a5611a5c-47c5-4f55-95d0-4c54b5af318b'} Sep 02 05:26:44.260621 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:26:44.260621 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:26:44.260621 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:26:44.260621 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:26:44.260621 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:26:44.260621 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:26:44.260621 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:26:44.260621 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:26:44.260621 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:26:44.260621 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:26:44.260621 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5611a5c-47c5-4f55-95d0-4c54b5af318b could not be found. Sep 02 05:26:44.260621 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:26:44.260621 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:26:44.260621 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:26:44.260621 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:26:44.260621 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:26:44.260621 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:26:44.260621 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:26:44.260621 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:26:44.260621 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:26:44.261834 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:26:44.261834 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:26:44.261834 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:26:44.261834 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:26:44.261834 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:26:44.261834 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:26:44.261834 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:26:44.261834 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5611a5c-47c5-4f55-95d0-4c54b5af318b could not be found. Sep 02 05:26:44.261834 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:26:44.261834 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:26:44.261834 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:26:44.261834 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:26:44.261834 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:26:44.261834 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:26:44.261834 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:26:44.261834 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:26:44.261834 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5611a5c-47c5-4f55-95d0-4c54b5af318b could not be found. Sep 02 05:26:44.261834 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:26:44.262883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-112f4202-4d7f-4cff-9d8e-1c6989550bc4 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Returning 404 to user: Instance a5611a5c-47c5-4f55-95d0-4c54b5af318b could not be found. {{(pid=120449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:26:44.262883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-112f4202-4d7f-4cff-9d8e-1c6989550bc4 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b" status: 404 len: 111 microversion: 2.1 time: 0.038293 Sep 02 05:26:44.262883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 294/581] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:26:44 2022] GET /compute/v2.1/servers/a5611a5c-47c5-4f55-95d0-4c54b5af318b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:26:51.775089 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-06e26f5b-9c35-45af-a714-9d091d5ed067 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:51.775658 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-06e26f5b-9c35-45af-a714-9d091d5ed067 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:51.782694 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-06e26f5b-9c35-45af-a714-9d091d5ed067 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:51.783183 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-06e26f5b-9c35-45af-a714-9d091d5ed067 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:51.783663 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-06e26f5b-9c35-45af-a714-9d091d5ed067 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:51.784395 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-06e26f5b-9c35-45af-a714-9d091d5ed067 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:51.784874 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-06e26f5b-9c35-45af-a714-9d091d5ed067 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:51.785272 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-06e26f5b-9c35-45af-a714-9d091d5ed067 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:51.787826 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:26:51.815024 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-06e26f5b-9c35-45af-a714-9d091d5ed067 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b/ips" status: 200 len: 149 microversion: 2.1 time: 0.043944 Sep 02 05:26:51.815490 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 288/582] 10.222.0.30 () {58 vars in 1248 bytes} [Fri Sep 2 05:26:51 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:26:52.619999 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-960a7a49-806a-49b3-b342-3d5cdc2ca7e0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:26:52.620873 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-960a7a49-806a-49b3-b342-3d5cdc2ca7e0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:52.624215 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_api:SELECT=26 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:26:52.633259 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-960a7a49-806a-49b3-b342-3d5cdc2ca7e0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:52.634050 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-960a7a49-806a-49b3-b342-3d5cdc2ca7e0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:52.634482 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-960a7a49-806a-49b3-b342-3d5cdc2ca7e0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:52.635161 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-960a7a49-806a-49b3-b342-3d5cdc2ca7e0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:52.635612 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-960a7a49-806a-49b3-b342-3d5cdc2ca7e0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:52.636057 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-960a7a49-806a-49b3-b342-3d5cdc2ca7e0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:52.638557 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=71 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:26:52.659645 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-960a7a49-806a-49b3-b342-3d5cdc2ca7e0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d/ips" status: 200 len: 151 microversion: 2.20 time: 0.046654 Sep 02 05:26:52.660185 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 295/583] 10.222.0.30 () {60 vars in 1289 bytes} [Fri Sep 2 05:26:52 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d/ips => generated 151 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 05:26:58.510431 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-0bf960ec-cddf-4dd0-9147-44d8f1441b39 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb70b01f-a826-47f2-a333-ea50559bdc18"}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:26:58.514708 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-0bf960ec-cddf-4dd0-9147-44d8f1441b39 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:58.524704 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0bf960ec-cddf-4dd0-9147-44d8f1441b39 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:58.525205 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0bf960ec-cddf-4dd0-9147-44d8f1441b39 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:58.525632 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0bf960ec-cddf-4dd0-9147-44d8f1441b39 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:58.526309 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0bf960ec-cddf-4dd0-9147-44d8f1441b39 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:58.526755 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0bf960ec-cddf-4dd0-9147-44d8f1441b39 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:58.527181 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0bf960ec-cddf-4dd0-9147-44d8f1441b39 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:58.837455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-0bf960ec-cddf-4dd0-9147-44d8f1441b39 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "POST /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333556 Sep 02 05:26:58.838449 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 289/584] 10.222.0.30 () {60 vars in 1323 bytes} [Fri Sep 2 05:26:58 2022] POST /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b/os-volume_attachments => generated 194 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:26:59.953693 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-4ab27e9f-6c6d-4729-bc4a-37760d45ddf3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:26:59.954207 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-4ab27e9f-6c6d-4729-bc4a-37760d45ddf3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:26:59.960566 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4ab27e9f-6c6d-4729-bc4a-37760d45ddf3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:59.961049 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4ab27e9f-6c6d-4729-bc4a-37760d45ddf3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:59.961618 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4ab27e9f-6c6d-4729-bc4a-37760d45ddf3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:59.962293 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4ab27e9f-6c6d-4729-bc4a-37760d45ddf3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:26:59.962741 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4ab27e9f-6c6d-4729-bc4a-37760d45ddf3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:26:59.963159 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4ab27e9f-6c6d-4729-bc4a-37760d45ddf3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:26:59.985755 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.objects.instance [None req-4ab27e9f-6c6d-4729-bc4a-37760d45ddf3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lazy-loading 'flavor' on Instance uuid 1e32b402-d6f2-4861-a864-005e1a9f808d {{(pid=120449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:27:00.168394 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-4ab27e9f-6c6d-4729-bc4a-37760d45ddf3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "POST /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d/action" status: 202 len: 0 microversion: 2.20 time: 0.218251 Sep 02 05:27:00.168899 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 296/585] 10.222.0.30 () {62 vars in 1319 bytes} [Fri Sep 2 05:26:59 2022] POST /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 05:27:00.179045 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-e9fd41d4-9df3-4685-ac1c-2b47ede6262c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:00.179598 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-e9fd41d4-9df3-4685-ac1c-2b47ede6262c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:00.181241 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:27:00.187421 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e9fd41d4-9df3-4685-ac1c-2b47ede6262c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:00.187925 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e9fd41d4-9df3-4685-ac1c-2b47ede6262c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:00.188455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e9fd41d4-9df3-4685-ac1c-2b47ede6262c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:00.189391 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e9fd41d4-9df3-4685-ac1c-2b47ede6262c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:00.189838 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e9fd41d4-9df3-4685-ac1c-2b47ede6262c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:00.190251 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e9fd41d4-9df3-4685-ac1c-2b47ede6262c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:00.324327 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-e9fd41d4-9df3-4685-ac1c-2b47ede6262c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:00.332812 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-e9fd41d4-9df3-4685-ac1c-2b47ede6262c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:00.334483 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-e9fd41d4-9df3-4685-ac1c-2b47ede6262c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:00.335654 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-e9fd41d4-9df3-4685-ac1c-2b47ede6262c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1721 microversion: 2.20 time: 0.161955 Sep 02 05:27:00.336205 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 290/586] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:00 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:27:01.363783 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ac3338ad-d2e5-4818-a588-12aa0ffdc71a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:01.364857 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-ac3338ad-d2e5-4818-a588-12aa0ffdc71a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:01.372923 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ac3338ad-d2e5-4818-a588-12aa0ffdc71a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:01.373407 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ac3338ad-d2e5-4818-a588-12aa0ffdc71a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:01.373846 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ac3338ad-d2e5-4818-a588-12aa0ffdc71a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:01.374535 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ac3338ad-d2e5-4818-a588-12aa0ffdc71a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:01.374990 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ac3338ad-d2e5-4818-a588-12aa0ffdc71a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:01.375419 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ac3338ad-d2e5-4818-a588-12aa0ffdc71a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:01.508107 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ac3338ad-d2e5-4818-a588-12aa0ffdc71a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:01.520431 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ac3338ad-d2e5-4818-a588-12aa0ffdc71a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:01.522782 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ac3338ad-d2e5-4818-a588-12aa0ffdc71a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:01.524480 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-ac3338ad-d2e5-4818-a588-12aa0ffdc71a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1721 microversion: 2.20 time: 0.167904 Sep 02 05:27:01.525005 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 297/587] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:01 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:02.547583 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-356aa385-f5b0-4965-a440-cdeddd43573e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:02.548230 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-356aa385-f5b0-4965-a440-cdeddd43573e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:02.555121 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-356aa385-f5b0-4965-a440-cdeddd43573e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:02.555635 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-356aa385-f5b0-4965-a440-cdeddd43573e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:02.556138 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-356aa385-f5b0-4965-a440-cdeddd43573e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:02.556879 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-356aa385-f5b0-4965-a440-cdeddd43573e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:02.557367 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-356aa385-f5b0-4965-a440-cdeddd43573e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:02.557818 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-356aa385-f5b0-4965-a440-cdeddd43573e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:02.689251 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-356aa385-f5b0-4965-a440-cdeddd43573e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:02.698868 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-356aa385-f5b0-4965-a440-cdeddd43573e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:02.700366 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-356aa385-f5b0-4965-a440-cdeddd43573e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:02.701531 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-356aa385-f5b0-4965-a440-cdeddd43573e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1721 microversion: 2.20 time: 0.158139 Sep 02 05:27:02.702095 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 291/588] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:02 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:03.725282 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-410cfa3d-b696-46d7-a4ef-481eaf16af23 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:03.725935 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-410cfa3d-b696-46d7-a4ef-481eaf16af23 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:03.732856 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-410cfa3d-b696-46d7-a4ef-481eaf16af23 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:03.733355 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-410cfa3d-b696-46d7-a4ef-481eaf16af23 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:03.733812 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-410cfa3d-b696-46d7-a4ef-481eaf16af23 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:03.734559 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-410cfa3d-b696-46d7-a4ef-481eaf16af23 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:03.735036 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-410cfa3d-b696-46d7-a4ef-481eaf16af23 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:03.735480 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-410cfa3d-b696-46d7-a4ef-481eaf16af23 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:03.870020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-410cfa3d-b696-46d7-a4ef-481eaf16af23 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:03.878311 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-410cfa3d-b696-46d7-a4ef-481eaf16af23 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:03.879741 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-410cfa3d-b696-46d7-a4ef-481eaf16af23 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:03.880929 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-410cfa3d-b696-46d7-a4ef-481eaf16af23 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1721 microversion: 2.20 time: 0.159899 Sep 02 05:27:03.881471 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 298/589] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:03 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:04.904019 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-dba46cf1-c975-4ba1-89b5-8502869b8fc9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:04.904618 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-dba46cf1-c975-4ba1-89b5-8502869b8fc9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:04.911651 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dba46cf1-c975-4ba1-89b5-8502869b8fc9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:04.912141 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dba46cf1-c975-4ba1-89b5-8502869b8fc9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:04.912581 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dba46cf1-c975-4ba1-89b5-8502869b8fc9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:04.913268 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dba46cf1-c975-4ba1-89b5-8502869b8fc9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:04.913709 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dba46cf1-c975-4ba1-89b5-8502869b8fc9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:04.914125 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dba46cf1-c975-4ba1-89b5-8502869b8fc9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:05.057649 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-dba46cf1-c975-4ba1-89b5-8502869b8fc9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:05.065971 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-dba46cf1-c975-4ba1-89b5-8502869b8fc9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:05.067355 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-dba46cf1-c975-4ba1-89b5-8502869b8fc9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:05.068570 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-dba46cf1-c975-4ba1-89b5-8502869b8fc9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1721 microversion: 2.20 time: 0.168456 Sep 02 05:27:05.069127 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 292/590] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:04 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:06.091605 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-cf94a319-21d6-4d03-b4f9-76ba3eac9b29 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:06.092565 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-cf94a319-21d6-4d03-b4f9-76ba3eac9b29 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:06.098965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cf94a319-21d6-4d03-b4f9-76ba3eac9b29 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:06.099441 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cf94a319-21d6-4d03-b4f9-76ba3eac9b29 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:06.099894 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cf94a319-21d6-4d03-b4f9-76ba3eac9b29 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:06.100615 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cf94a319-21d6-4d03-b4f9-76ba3eac9b29 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:06.101062 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cf94a319-21d6-4d03-b4f9-76ba3eac9b29 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:06.101478 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cf94a319-21d6-4d03-b4f9-76ba3eac9b29 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:06.243052 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-cf94a319-21d6-4d03-b4f9-76ba3eac9b29 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:06.251495 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-cf94a319-21d6-4d03-b4f9-76ba3eac9b29 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:06.253041 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-cf94a319-21d6-4d03-b4f9-76ba3eac9b29 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:06.254198 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-cf94a319-21d6-4d03-b4f9-76ba3eac9b29 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1721 microversion: 2.20 time: 0.166529 Sep 02 05:27:06.254756 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 299/591] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:06 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:06.836724 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-4c574fc9-8b15-4b54-b0ed-852f112ab446 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-163051535", "imageRef": "f3669111-2e3f-4f39-878f-19d263505eaa", "flavorRef": "452", "networks": [{"uuid": "25225075-5c9c-4031-8f93-0a61f603882b"}]}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:27:06.892886 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.network.neutron [None req-4c574fc9-8b15-4b54-b0ed-852f112ab446 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] validate_networks() for [('25225075-5c9c-4031-8f93-0a61f603882b', None, None, None, None, None)] {{(pid=120448) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 05:27:07.266438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-4c574fc9-8b15-4b54-b0ed-852f112ab446 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Flavor limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 05:27:07.266834 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-4c574fc9-8b15-4b54-b0ed-852f112ab446 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Image limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 05:27:07.267300 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-4c574fc9-8b15-4b54-b0ed-852f112ab446 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Flavor pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 05:27:07.267694 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-4c574fc9-8b15-4b54-b0ed-852f112ab446 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Image pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 05:27:07.268095 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-4c574fc9-8b15-4b54-b0ed-852f112ab446 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 05:27:07.277250 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5ce67c41-5594-4e93-9b0e-033ddf30e119 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:07.277814 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4c574fc9-8b15-4b54-b0ed-852f112ab446 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:07.277957 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5ce67c41-5594-4e93-9b0e-033ddf30e119 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:07.278287 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4c574fc9-8b15-4b54-b0ed-852f112ab446 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:07.278736 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4c574fc9-8b15-4b54-b0ed-852f112ab446 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:07.279424 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4c574fc9-8b15-4b54-b0ed-852f112ab446 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:07.279866 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4c574fc9-8b15-4b54-b0ed-852f112ab446 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:07.280315 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4c574fc9-8b15-4b54-b0ed-852f112ab446 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:07.283883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5ce67c41-5594-4e93-9b0e-033ddf30e119 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:07.284409 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5ce67c41-5594-4e93-9b0e-033ddf30e119 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:07.284839 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5ce67c41-5594-4e93-9b0e-033ddf30e119 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:07.285543 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5ce67c41-5594-4e93-9b0e-033ddf30e119 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:07.285992 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5ce67c41-5594-4e93-9b0e-033ddf30e119 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:07.286412 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5ce67c41-5594-4e93-9b0e-033ddf30e119 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:07.297198 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-4c574fc9-8b15-4b54-b0ed-852f112ab446 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Getting quotas for project a0bc748ee5804c9499d0c0b80e14d711. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:27:07.301221 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-4c574fc9-8b15-4b54-b0ed-852f112ab446 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Getting quotas for user c5943ce507ca4e67928bc1b98c9e8edb and project a0bc748ee5804c9499d0c0b80e14d711. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:27:07.312336 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-4c574fc9-8b15-4b54-b0ed-852f112ab446 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Going to run 1 instances... {{(pid=120448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 05:27:07.314630 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-4c574fc9-8b15-4b54-b0ed-852f112ab446 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: 985ff518-439b-4f6e-9b9d-d83260bad8ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3669111-2e3f-4f39-878f-19d263505eaa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 05:27:07.361559 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-4c574fc9-8b15-4b54-b0ed-852f112ab446 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529016 Sep 02 05:27:07.368453 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 293/592] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Sep 2 05:27:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 05:27:07.375311 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-7c052ac2-51bd-48b2-906e-80b5fab583b8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:07.375989 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-7c052ac2-51bd-48b2-906e-80b5fab583b8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: 985ff518-439b-4f6e-9b9d-d83260bad8ea] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:07.453493 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-7c052ac2-51bd-48b2-906e-80b5fab583b8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:07.460292 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5ce67c41-5594-4e93-9b0e-033ddf30e119 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:07.460504 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-7c052ac2-51bd-48b2-906e-80b5fab583b8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea" status: 200 len: 1218 microversion: 2.1 time: 0.090710 Sep 02 05:27:07.461858 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 294/593] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:07 2022] GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:07.468542 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5ce67c41-5594-4e93-9b0e-033ddf30e119 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:07.469863 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5ce67c41-5594-4e93-9b0e-033ddf30e119 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:07.471033 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5ce67c41-5594-4e93-9b0e-033ddf30e119 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1721 microversion: 2.20 time: 0.197767 Sep 02 05:27:07.471591 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 300/594] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:07 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:08.481906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-c5ab51d7-290b-419a-a29b-2d05421e525e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:08.482532 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-c5ab51d7-290b-419a-a29b-2d05421e525e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: 985ff518-439b-4f6e-9b9d-d83260bad8ea] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:08.489216 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c5ab51d7-290b-419a-a29b-2d05421e525e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:08.489706 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c5ab51d7-290b-419a-a29b-2d05421e525e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:08.490339 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c5ab51d7-290b-419a-a29b-2d05421e525e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:08.491036 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c5ab51d7-290b-419a-a29b-2d05421e525e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:08.491826 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c5ab51d7-290b-419a-a29b-2d05421e525e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:08.492278 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c5ab51d7-290b-419a-a29b-2d05421e525e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:08.495412 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-3d4fc91f-1db7-4965-97f6-0ee3d912be9e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:08.496091 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-3d4fc91f-1db7-4965-97f6-0ee3d912be9e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:08.502582 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3d4fc91f-1db7-4965-97f6-0ee3d912be9e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:08.503121 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3d4fc91f-1db7-4965-97f6-0ee3d912be9e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:08.503521 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3d4fc91f-1db7-4965-97f6-0ee3d912be9e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:08.504244 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3d4fc91f-1db7-4965-97f6-0ee3d912be9e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:08.504772 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3d4fc91f-1db7-4965-97f6-0ee3d912be9e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:08.505197 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3d4fc91f-1db7-4965-97f6-0ee3d912be9e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:08.564665 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c5ab51d7-290b-419a-a29b-2d05421e525e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:08.572784 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-c5ab51d7-290b-419a-a29b-2d05421e525e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea" status: 200 len: 1270 microversion: 2.1 time: 0.094736 Sep 02 05:27:08.573447 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 295/595] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:08 2022] GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea => generated 1270 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:08.656042 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-3d4fc91f-1db7-4965-97f6-0ee3d912be9e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:08.667416 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-3d4fc91f-1db7-4965-97f6-0ee3d912be9e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:08.668893 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-3d4fc91f-1db7-4965-97f6-0ee3d912be9e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:08.670090 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-3d4fc91f-1db7-4965-97f6-0ee3d912be9e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1721 microversion: 2.20 time: 0.179098 Sep 02 05:27:08.670659 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 301/596] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:08 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:27:09.594336 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-58c29863-474d-4e97-8fdb-1baf72288c89 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:09.594865 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-58c29863-474d-4e97-8fdb-1baf72288c89 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: 985ff518-439b-4f6e-9b9d-d83260bad8ea] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:09.601713 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-58c29863-474d-4e97-8fdb-1baf72288c89 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:09.602246 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-58c29863-474d-4e97-8fdb-1baf72288c89 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:09.602681 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-58c29863-474d-4e97-8fdb-1baf72288c89 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:09.603354 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-58c29863-474d-4e97-8fdb-1baf72288c89 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:09.603826 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-58c29863-474d-4e97-8fdb-1baf72288c89 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:09.604290 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-58c29863-474d-4e97-8fdb-1baf72288c89 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:09.698368 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-295d5f70-c1f2-4982-924b-832998ff8bce tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:09.699004 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-295d5f70-c1f2-4982-924b-832998ff8bce tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:09.705963 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-295d5f70-c1f2-4982-924b-832998ff8bce tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:09.706449 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-295d5f70-c1f2-4982-924b-832998ff8bce tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:09.706880 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-295d5f70-c1f2-4982-924b-832998ff8bce tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:09.707563 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-295d5f70-c1f2-4982-924b-832998ff8bce tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:09.707985 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-295d5f70-c1f2-4982-924b-832998ff8bce tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:09.708435 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-295d5f70-c1f2-4982-924b-832998ff8bce tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:09.828884 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-58c29863-474d-4e97-8fdb-1baf72288c89 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:09.837087 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-58c29863-474d-4e97-8fdb-1baf72288c89 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea" status: 200 len: 1318 microversion: 2.1 time: 0.246750 Sep 02 05:27:09.838034 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 296/597] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:09 2022] GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:09.931625 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-295d5f70-c1f2-4982-924b-832998ff8bce tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:09.941246 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-295d5f70-c1f2-4982-924b-832998ff8bce tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:09.942688 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-295d5f70-c1f2-4982-924b-832998ff8bce tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:09.943849 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-295d5f70-c1f2-4982-924b-832998ff8bce tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1721 microversion: 2.20 time: 0.254365 Sep 02 05:27:09.944448 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 302/598] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:09 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1721 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:10.339884 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-88019aa7-6ed3-4b7f-9496-3c08188d0e73 req-45b3b206-1e64-4d10-8f40-90c11cf0629a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "985ff518-439b-4f6e-9b9d-d83260bad8ea", "tag": "c7f90668-6146-4987-9b47-3573fe921638"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:27:10.349507 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-88019aa7-6ed3-4b7f-9496-3c08188d0e73 req-45b3b206-1e64-4d10-8f40-90c11cf0629a service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:10.349982 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-88019aa7-6ed3-4b7f-9496-3c08188d0e73 req-45b3b206-1e64-4d10-8f40-90c11cf0629a service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:10.350428 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-88019aa7-6ed3-4b7f-9496-3c08188d0e73 req-45b3b206-1e64-4d10-8f40-90c11cf0629a service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:10.361165 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-88019aa7-6ed3-4b7f-9496-3c08188d0e73 req-45b3b206-1e64-4d10-8f40-90c11cf0629a service nova] Creating event network-changed:c7f90668-6146-4987-9b47-3573fe921638 for instance 985ff518-439b-4f6e-9b9d-d83260bad8ea on hv-cinder-85391 Sep 02 05:27:10.366502 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-88019aa7-6ed3-4b7f-9496-3c08188d0e73 req-45b3b206-1e64-4d10-8f40-90c11cf0629a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030177 Sep 02 05:27:10.367100 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 297/599] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:27:10.863131 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5b4ea65e-1647-4a9b-b542-c342014e16a6 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:10.864545 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5b4ea65e-1647-4a9b-b542-c342014e16a6 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: 985ff518-439b-4f6e-9b9d-d83260bad8ea] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:10.877156 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5b4ea65e-1647-4a9b-b542-c342014e16a6 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:10.878537 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5b4ea65e-1647-4a9b-b542-c342014e16a6 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:10.879830 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5b4ea65e-1647-4a9b-b542-c342014e16a6 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:10.881934 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5b4ea65e-1647-4a9b-b542-c342014e16a6 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:10.883399 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5b4ea65e-1647-4a9b-b542-c342014e16a6 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:10.883806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5b4ea65e-1647-4a9b-b542-c342014e16a6 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:10.969063 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-aec4ad41-b7b3-4750-85ad-051991de5171 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:10.969063 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-aec4ad41-b7b3-4750-85ad-051991de5171 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:10.977726 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-aec4ad41-b7b3-4750-85ad-051991de5171 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:10.978213 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-aec4ad41-b7b3-4750-85ad-051991de5171 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:10.978672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-aec4ad41-b7b3-4750-85ad-051991de5171 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:10.979360 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-aec4ad41-b7b3-4750-85ad-051991de5171 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:10.979810 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-aec4ad41-b7b3-4750-85ad-051991de5171 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:10.980269 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-aec4ad41-b7b3-4750-85ad-051991de5171 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:11.032363 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5b4ea65e-1647-4a9b-b542-c342014e16a6 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:11.040322 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5b4ea65e-1647-4a9b-b542-c342014e16a6 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea" status: 200 len: 1318 microversion: 2.1 time: 0.184205 Sep 02 05:27:11.041104 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 303/600] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:10 2022] GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:11.114242 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-aec4ad41-b7b3-4750-85ad-051991de5171 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:11.123170 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-aec4ad41-b7b3-4750-85ad-051991de5171 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:11.124666 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-aec4ad41-b7b3-4750-85ad-051991de5171 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:11.125819 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-aec4ad41-b7b3-4750-85ad-051991de5171 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1721 microversion: 2.20 time: 0.162302 Sep 02 05:27:11.126484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 298/601] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:10 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:12.065607 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-2329818e-5380-4c0d-9ab7-55ffe5aa0503 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:12.066662 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-2329818e-5380-4c0d-9ab7-55ffe5aa0503 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: 985ff518-439b-4f6e-9b9d-d83260bad8ea] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:12.077349 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2329818e-5380-4c0d-9ab7-55ffe5aa0503 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:12.078211 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2329818e-5380-4c0d-9ab7-55ffe5aa0503 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:12.078926 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2329818e-5380-4c0d-9ab7-55ffe5aa0503 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:12.080101 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2329818e-5380-4c0d-9ab7-55ffe5aa0503 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:12.080848 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2329818e-5380-4c0d-9ab7-55ffe5aa0503 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:12.081548 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2329818e-5380-4c0d-9ab7-55ffe5aa0503 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:12.148926 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-dcacdb6f-a524-4095-bf15-abb2d91371f4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:12.149631 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-dcacdb6f-a524-4095-bf15-abb2d91371f4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:12.156734 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dcacdb6f-a524-4095-bf15-abb2d91371f4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:12.157292 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dcacdb6f-a524-4095-bf15-abb2d91371f4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:12.157813 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dcacdb6f-a524-4095-bf15-abb2d91371f4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:12.158575 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dcacdb6f-a524-4095-bf15-abb2d91371f4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:12.159689 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dcacdb6f-a524-4095-bf15-abb2d91371f4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:12.160106 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dcacdb6f-a524-4095-bf15-abb2d91371f4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:12.248149 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-2329818e-5380-4c0d-9ab7-55ffe5aa0503 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:12.256755 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-2329818e-5380-4c0d-9ab7-55ffe5aa0503 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea" status: 200 len: 1318 microversion: 2.1 time: 0.197791 Sep 02 05:27:12.257299 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 304/602] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:12 2022] GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:12.308070 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-dcacdb6f-a524-4095-bf15-abb2d91371f4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:12.316462 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-dcacdb6f-a524-4095-bf15-abb2d91371f4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:12.317857 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-dcacdb6f-a524-4095-bf15-abb2d91371f4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:12.319013 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-dcacdb6f-a524-4095-bf15-abb2d91371f4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1721 microversion: 2.20 time: 0.174224 Sep 02 05:27:12.319567 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 299/603] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:12 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:13.281651 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-a744a250-dd10-48a7-afe8-693a12eaa895 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:13.282208 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-a744a250-dd10-48a7-afe8-693a12eaa895 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: 985ff518-439b-4f6e-9b9d-d83260bad8ea] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:13.292431 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a744a250-dd10-48a7-afe8-693a12eaa895 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:13.293594 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a744a250-dd10-48a7-afe8-693a12eaa895 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:13.294219 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a744a250-dd10-48a7-afe8-693a12eaa895 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:13.295134 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a744a250-dd10-48a7-afe8-693a12eaa895 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:13.295725 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a744a250-dd10-48a7-afe8-693a12eaa895 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:13.296361 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a744a250-dd10-48a7-afe8-693a12eaa895 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:13.342248 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-72653181-c45f-430d-ad86-4f952efc25e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:13.342891 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-72653181-c45f-430d-ad86-4f952efc25e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:13.349475 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-72653181-c45f-430d-ad86-4f952efc25e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:13.349962 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-72653181-c45f-430d-ad86-4f952efc25e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:13.350398 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-72653181-c45f-430d-ad86-4f952efc25e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:13.351091 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-72653181-c45f-430d-ad86-4f952efc25e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:13.351541 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-72653181-c45f-430d-ad86-4f952efc25e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:13.352000 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-72653181-c45f-430d-ad86-4f952efc25e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:13.488153 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-a744a250-dd10-48a7-afe8-693a12eaa895 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:13.497040 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-a744a250-dd10-48a7-afe8-693a12eaa895 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea" status: 200 len: 1318 microversion: 2.1 time: 0.222039 Sep 02 05:27:13.497707 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 305/604] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:13 2022] GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:13.514674 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-72653181-c45f-430d-ad86-4f952efc25e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:13.522959 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-72653181-c45f-430d-ad86-4f952efc25e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:13.524475 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-72653181-c45f-430d-ad86-4f952efc25e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:13.525624 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-72653181-c45f-430d-ad86-4f952efc25e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1721 microversion: 2.20 time: 0.187451 Sep 02 05:27:13.526271 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 300/605] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:13 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:14.521221 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-8537a691-e797-4efb-9902-e5cbecdd7d4d tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:14.522198 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-8537a691-e797-4efb-9902-e5cbecdd7d4d tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: 985ff518-439b-4f6e-9b9d-d83260bad8ea] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:14.531676 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8537a691-e797-4efb-9902-e5cbecdd7d4d tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:14.532398 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8537a691-e797-4efb-9902-e5cbecdd7d4d tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:14.533030 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8537a691-e797-4efb-9902-e5cbecdd7d4d tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:14.534089 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8537a691-e797-4efb-9902-e5cbecdd7d4d tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:14.534730 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8537a691-e797-4efb-9902-e5cbecdd7d4d tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:14.535346 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8537a691-e797-4efb-9902-e5cbecdd7d4d tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:14.549003 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f8a1fc41-5e03-4601-821d-f31acb2cd44f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:14.549606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f8a1fc41-5e03-4601-821d-f31acb2cd44f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:14.556485 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f8a1fc41-5e03-4601-821d-f31acb2cd44f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:14.556970 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f8a1fc41-5e03-4601-821d-f31acb2cd44f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:14.557408 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f8a1fc41-5e03-4601-821d-f31acb2cd44f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:14.558096 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f8a1fc41-5e03-4601-821d-f31acb2cd44f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:14.558666 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f8a1fc41-5e03-4601-821d-f31acb2cd44f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:14.558974 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f8a1fc41-5e03-4601-821d-f31acb2cd44f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:14.735691 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-8537a691-e797-4efb-9902-e5cbecdd7d4d tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:14.739786 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f8a1fc41-5e03-4601-821d-f31acb2cd44f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:14.743912 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-8537a691-e797-4efb-9902-e5cbecdd7d4d tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea" status: 200 len: 1318 microversion: 2.1 time: 0.229180 Sep 02 05:27:14.744565 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 306/606] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:14 2022] GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:14.748962 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f8a1fc41-5e03-4601-821d-f31acb2cd44f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:14.750376 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f8a1fc41-5e03-4601-821d-f31acb2cd44f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:14.751549 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f8a1fc41-5e03-4601-821d-f31acb2cd44f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1721 microversion: 2.20 time: 0.206454 Sep 02 05:27:14.752287 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 301/607] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:14 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:15.764463 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-72cb18cd-3a24-4566-99ab-f92a084ea346 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:15.765068 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-72cb18cd-3a24-4566-99ab-f92a084ea346 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: 985ff518-439b-4f6e-9b9d-d83260bad8ea] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:15.771554 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-72cb18cd-3a24-4566-99ab-f92a084ea346 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:15.772063 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-72cb18cd-3a24-4566-99ab-f92a084ea346 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:15.772505 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-72cb18cd-3a24-4566-99ab-f92a084ea346 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:15.773215 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-72cb18cd-3a24-4566-99ab-f92a084ea346 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:15.773669 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-72cb18cd-3a24-4566-99ab-f92a084ea346 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:15.773851 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-1fa0ccb7-ea84-4e2e-92a8-60cf7de7dede tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:15.774266 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-72cb18cd-3a24-4566-99ab-f92a084ea346 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:15.774488 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-1fa0ccb7-ea84-4e2e-92a8-60cf7de7dede tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:15.781241 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1fa0ccb7-ea84-4e2e-92a8-60cf7de7dede tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:15.781732 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1fa0ccb7-ea84-4e2e-92a8-60cf7de7dede tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:15.782176 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1fa0ccb7-ea84-4e2e-92a8-60cf7de7dede tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:15.782865 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1fa0ccb7-ea84-4e2e-92a8-60cf7de7dede tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:15.783301 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1fa0ccb7-ea84-4e2e-92a8-60cf7de7dede tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:15.783721 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1fa0ccb7-ea84-4e2e-92a8-60cf7de7dede tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:16.066507 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-72cb18cd-3a24-4566-99ab-f92a084ea346 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:16.072453 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-1fa0ccb7-ea84-4e2e-92a8-60cf7de7dede tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:16.075660 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-72cb18cd-3a24-4566-99ab-f92a084ea346 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea" status: 200 len: 1318 microversion: 2.1 time: 0.315006 Sep 02 05:27:16.076559 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 307/608] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:15 2022] GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:16.090614 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-1fa0ccb7-ea84-4e2e-92a8-60cf7de7dede tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:16.092180 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-1fa0ccb7-ea84-4e2e-92a8-60cf7de7dede tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:16.093465 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-1fa0ccb7-ea84-4e2e-92a8-60cf7de7dede tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1721 microversion: 2.20 time: 0.323552 Sep 02 05:27:16.094041 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 302/609] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:15 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1721 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:17.077803 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-7bf1bd9b-9840-4f1c-8f35-9868db81ec9e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Action: 'create', calling method: .version_select at 0x7fc90b537f70>, body: {"keypair": {"name": "tempest-keypair-567933332", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCA80Znw8DJuFC0gns8qV7OEjfRxp6FeYC33uVZ2CBhmh7A2aM0cXwJke4k98LAYwzx2X6oOOw0VFUyyo5/PGF6IVzK8km6qZt0ZOmC6YqSV5zKNgeIR6gGu41Rf1BvSgA=="}} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:27:17.095715 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.quota [None req-7bf1bd9b-9840-4f1c-8f35-9868db81ec9e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Getting quotas for project 0847ca942df54b659e8723463ab72c65. Resources: {'key_pairs'} {{(pid=120449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:27:17.096392 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-506f4cb3-e5c7-45fc-87e3-1d3b4cfb6f5f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:17.097040 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-506f4cb3-e5c7-45fc-87e3-1d3b4cfb6f5f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: 985ff518-439b-4f6e-9b9d-d83260bad8ea] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:17.100272 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.quota [None req-7bf1bd9b-9840-4f1c-8f35-9868db81ec9e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Getting quotas for user ee1a3027b52f4b46bc5cff18f9cd0b02 and project 0847ca942df54b659e8723463ab72c65. Resources: {'key_pairs'} {{(pid=120449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:27:17.103098 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-506f4cb3-e5c7-45fc-87e3-1d3b4cfb6f5f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:17.103588 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-506f4cb3-e5c7-45fc-87e3-1d3b4cfb6f5f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:17.104026 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-506f4cb3-e5c7-45fc-87e3-1d3b4cfb6f5f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:17.104756 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-506f4cb3-e5c7-45fc-87e3-1d3b4cfb6f5f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:17.105206 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-506f4cb3-e5c7-45fc-87e3-1d3b4cfb6f5f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:17.105626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-506f4cb3-e5c7-45fc-87e3-1d3b4cfb6f5f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:17.126374 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-7bf1bd9b-9840-4f1c-8f35-9868db81ec9e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052567 Sep 02 05:27:17.132903 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 308/610] 10.222.0.30 () {60 vars in 1159 bytes} [Fri Sep 2 05:27:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:27:17.132903 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-0199d050-9524-42ac-a34b-4dcc369d1c23 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:17.132903 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-0199d050-9524-42ac-a34b-4dcc369d1c23 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:17.139137 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0199d050-9524-42ac-a34b-4dcc369d1c23 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:17.139681 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0199d050-9524-42ac-a34b-4dcc369d1c23 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:17.140331 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0199d050-9524-42ac-a34b-4dcc369d1c23 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:17.140992 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0199d050-9524-42ac-a34b-4dcc369d1c23 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:17.141510 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0199d050-9524-42ac-a34b-4dcc369d1c23 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:17.142010 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0199d050-9524-42ac-a34b-4dcc369d1c23 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:17.287822 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell0:SELECT=2 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:27:17.360818 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-506f4cb3-e5c7-45fc-87e3-1d3b4cfb6f5f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:17.369153 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-506f4cb3-e5c7-45fc-87e3-1d3b4cfb6f5f tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea" status: 200 len: 1318 microversion: 2.1 time: 0.276456 Sep 02 05:27:17.369729 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 303/611] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:17 2022] GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:17.373621 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-0199d050-9524-42ac-a34b-4dcc369d1c23 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:17.382256 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-0199d050-9524-42ac-a34b-4dcc369d1c23 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:17.383681 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-0199d050-9524-42ac-a34b-4dcc369d1c23 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:17.385033 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-0199d050-9524-42ac-a34b-4dcc369d1c23 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1721 microversion: 2.20 time: 0.256801 Sep 02 05:27:17.385612 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 309/612] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:17 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1721 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:18.390313 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-c7ec09ea-e735-4af1-8014-c1a68ba7f136 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:18.391660 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-c7ec09ea-e735-4af1-8014-c1a68ba7f136 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: 985ff518-439b-4f6e-9b9d-d83260bad8ea] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:18.394853 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell0:SELECT=8 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:27:18.399033 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c7ec09ea-e735-4af1-8014-c1a68ba7f136 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:18.399513 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c7ec09ea-e735-4af1-8014-c1a68ba7f136 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:18.399947 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c7ec09ea-e735-4af1-8014-c1a68ba7f136 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:18.400682 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c7ec09ea-e735-4af1-8014-c1a68ba7f136 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:18.401288 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c7ec09ea-e735-4af1-8014-c1a68ba7f136 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:18.401758 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c7ec09ea-e735-4af1-8014-c1a68ba7f136 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:18.409990 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-42489826-1f3f-471c-8ef0-ccab9b8023ec tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:18.410426 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-42489826-1f3f-471c-8ef0-ccab9b8023ec tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:18.417360 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-42489826-1f3f-471c-8ef0-ccab9b8023ec tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:18.418147 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-42489826-1f3f-471c-8ef0-ccab9b8023ec tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:18.418587 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-42489826-1f3f-471c-8ef0-ccab9b8023ec tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:18.419266 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-42489826-1f3f-471c-8ef0-ccab9b8023ec tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:18.420025 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-42489826-1f3f-471c-8ef0-ccab9b8023ec tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:18.420151 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-42489826-1f3f-471c-8ef0-ccab9b8023ec tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:18.610372 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c7ec09ea-e735-4af1-8014-c1a68ba7f136 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:18.620011 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-c7ec09ea-e735-4af1-8014-c1a68ba7f136 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea" status: 200 len: 1318 microversion: 2.1 time: 0.233741 Sep 02 05:27:18.620603 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 304/613] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:18 2022] GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:18.621179 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-42489826-1f3f-471c-8ef0-ccab9b8023ec tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:18.625982 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d01ac6d8-322d-4d2c-9a88-58bf338d5191 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-221861501", "imageRef": "f3669111-2e3f-4f39-878f-19d263505eaa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64176975-8c6d-4d21-8413-773e395248ec"}], "security_groups": [{"name": "tempest-securitygroup--1197137981"}], "key_name": "tempest-keypair-567933332", "user_data": "}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:27:18.630839 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-42489826-1f3f-471c-8ef0-ccab9b8023ec tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:18.632342 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-42489826-1f3f-471c-8ef0-ccab9b8023ec tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:18.634199 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-42489826-1f3f-471c-8ef0-ccab9b8023ec tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1721 microversion: 2.20 time: 0.228219 Sep 02 05:27:18.634947 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 310/614] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:18 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1721 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:18.732641 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.network.neutron [None req-d01ac6d8-322d-4d2c-9a88-58bf338d5191 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] validate_networks() for [('64176975-8c6d-4d21-8413-773e395248ec', None, None, None, None, None)] {{(pid=120448) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 05:27:19.127093 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-d01ac6d8-322d-4d2c-9a88-58bf338d5191 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Flavor limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 05:27:19.127513 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-d01ac6d8-322d-4d2c-9a88-58bf338d5191 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Image limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 05:27:19.127974 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-d01ac6d8-322d-4d2c-9a88-58bf338d5191 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Flavor pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 05:27:19.128401 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-d01ac6d8-322d-4d2c-9a88-58bf338d5191 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Image pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 05:27:19.128804 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-d01ac6d8-322d-4d2c-9a88-58bf338d5191 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 05:27:19.141431 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d01ac6d8-322d-4d2c-9a88-58bf338d5191 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:19.141959 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d01ac6d8-322d-4d2c-9a88-58bf338d5191 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:19.142562 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d01ac6d8-322d-4d2c-9a88-58bf338d5191 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:19.143688 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d01ac6d8-322d-4d2c-9a88-58bf338d5191 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:19.144323 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d01ac6d8-322d-4d2c-9a88-58bf338d5191 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:19.144865 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d01ac6d8-322d-4d2c-9a88-58bf338d5191 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:19.164944 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-d01ac6d8-322d-4d2c-9a88-58bf338d5191 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Getting quotas for project 0847ca942df54b659e8723463ab72c65. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:27:19.169410 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-d01ac6d8-322d-4d2c-9a88-58bf338d5191 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Getting quotas for user ee1a3027b52f4b46bc5cff18f9cd0b02 and project 0847ca942df54b659e8723463ab72c65. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:27:19.181594 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-d01ac6d8-322d-4d2c-9a88-58bf338d5191 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Going to run 1 instances... {{(pid=120448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 05:27:19.183903 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-d01ac6d8-322d-4d2c-9a88-58bf338d5191 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3669111-2e3f-4f39-878f-19d263505eaa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 05:27:19.242481 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-d01ac6d8-322d-4d2c-9a88-58bf338d5191 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.620773 Sep 02 05:27:19.243291 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 305/615] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Sep 2 05:27:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 05:27:19.254263 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-796f83d9-95a7-47de-ad11-8fb25d57c8db tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:19.255080 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-796f83d9-95a7-47de-ad11-8fb25d57c8db tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:19.316330 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-796f83d9-95a7-47de-ad11-8fb25d57c8db tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:19.323414 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-796f83d9-95a7-47de-ad11-8fb25d57c8db tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a" status: 200 len: 1240 microversion: 2.1 time: 0.072895 Sep 02 05:27:19.323968 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 311/616] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:19 2022] GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:19.641186 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-5f3edcf3-3750-4961-a5d9-dabc24cf6c98 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:19.641790 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-5f3edcf3-3750-4961-a5d9-dabc24cf6c98 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: 985ff518-439b-4f6e-9b9d-d83260bad8ea] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:19.650130 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5f3edcf3-3750-4961-a5d9-dabc24cf6c98 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:19.650601 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5f3edcf3-3750-4961-a5d9-dabc24cf6c98 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:19.651025 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5f3edcf3-3750-4961-a5d9-dabc24cf6c98 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:19.651703 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5f3edcf3-3750-4961-a5d9-dabc24cf6c98 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:19.652162 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5f3edcf3-3750-4961-a5d9-dabc24cf6c98 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:19.652578 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5f3edcf3-3750-4961-a5d9-dabc24cf6c98 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:19.658021 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-002107c2-42e5-4711-8bdd-0776349f9803 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:19.658693 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-002107c2-42e5-4711-8bdd-0776349f9803 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:19.664646 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-002107c2-42e5-4711-8bdd-0776349f9803 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:19.665144 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-002107c2-42e5-4711-8bdd-0776349f9803 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:19.665571 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-002107c2-42e5-4711-8bdd-0776349f9803 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:19.666269 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-002107c2-42e5-4711-8bdd-0776349f9803 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:19.666712 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-002107c2-42e5-4711-8bdd-0776349f9803 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:19.667654 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-002107c2-42e5-4711-8bdd-0776349f9803 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:19.671430 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:27:20.234981 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-002107c2-42e5-4711-8bdd-0776349f9803 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:20.238641 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-5f3edcf3-3750-4961-a5d9-dabc24cf6c98 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:20.240949 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:27:20.249070 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-002107c2-42e5-4711-8bdd-0776349f9803 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:20.250544 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-002107c2-42e5-4711-8bdd-0776349f9803 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:20.256854 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-5f3edcf3-3750-4961-a5d9-dabc24cf6c98 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea" status: 200 len: 1318 microversion: 2.1 time: 0.619960 Sep 02 05:27:20.257425 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 306/617] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:19 2022] GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea => generated 1318 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:27:20.257794 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-002107c2-42e5-4711-8bdd-0776349f9803 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1721 microversion: 2.20 time: 0.597481 Sep 02 05:27:20.258349 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 312/618] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:19 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1721 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:20.344444 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-268537cd-b8cc-41bf-8a7b-7c9df721fd4f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:20.345052 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-268537cd-b8cc-41bf-8a7b-7c9df721fd4f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:20.352328 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-268537cd-b8cc-41bf-8a7b-7c9df721fd4f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:20.352785 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-268537cd-b8cc-41bf-8a7b-7c9df721fd4f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:20.353216 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-268537cd-b8cc-41bf-8a7b-7c9df721fd4f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:20.353914 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-268537cd-b8cc-41bf-8a7b-7c9df721fd4f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:20.354353 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-268537cd-b8cc-41bf-8a7b-7c9df721fd4f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:20.354765 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-268537cd-b8cc-41bf-8a7b-7c9df721fd4f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:20.417438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-268537cd-b8cc-41bf-8a7b-7c9df721fd4f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:20.425574 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-268537cd-b8cc-41bf-8a7b-7c9df721fd4f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a" status: 200 len: 1292 microversion: 2.1 time: 0.085141 Sep 02 05:27:20.426225 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 307/619] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:20 2022] GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a => generated 1292 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:21.281454 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-dd39f6f0-30f2-43dc-af95-bf6bc73aebc8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:21.282479 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-dd39f6f0-30f2-43dc-af95-bf6bc73aebc8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: 985ff518-439b-4f6e-9b9d-d83260bad8ea] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:21.285010 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-83468ddb-fc03-4eed-99b3-fe6f20584c4b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:21.286008 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-83468ddb-fc03-4eed-99b3-fe6f20584c4b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:21.292318 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dd39f6f0-30f2-43dc-af95-bf6bc73aebc8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:21.293090 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dd39f6f0-30f2-43dc-af95-bf6bc73aebc8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:21.293818 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dd39f6f0-30f2-43dc-af95-bf6bc73aebc8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:21.294787 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dd39f6f0-30f2-43dc-af95-bf6bc73aebc8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:21.295146 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dd39f6f0-30f2-43dc-af95-bf6bc73aebc8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:21.295546 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dd39f6f0-30f2-43dc-af95-bf6bc73aebc8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:21.296156 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-83468ddb-fc03-4eed-99b3-fe6f20584c4b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:21.296649 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-83468ddb-fc03-4eed-99b3-fe6f20584c4b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:21.297084 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-83468ddb-fc03-4eed-99b3-fe6f20584c4b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:21.297776 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-83468ddb-fc03-4eed-99b3-fe6f20584c4b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:21.298227 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-83468ddb-fc03-4eed-99b3-fe6f20584c4b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:21.298677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-83468ddb-fc03-4eed-99b3-fe6f20584c4b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:21.492312 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-dd39f6f0-30f2-43dc-af95-bf6bc73aebc8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:21.495976 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-83468ddb-fc03-4eed-99b3-fe6f20584c4b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:21.502469 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-dd39f6f0-30f2-43dc-af95-bf6bc73aebc8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea" status: 200 len: 1318 microversion: 2.1 time: 0.227436 Sep 02 05:27:21.503345 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 313/620] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:21 2022] GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:21.505331 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-83468ddb-fc03-4eed-99b3-fe6f20584c4b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:21.507047 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-83468ddb-fc03-4eed-99b3-fe6f20584c4b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:21.508237 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-abc15fde-7175-4cf5-b1f9-a75b8df04532 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:21.509368 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-abc15fde-7175-4cf5-b1f9-a75b8df04532 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:21.510057 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-83468ddb-fc03-4eed-99b3-fe6f20584c4b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1721 microversion: 2.20 time: 0.231661 Sep 02 05:27:21.524791 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-abc15fde-7175-4cf5-b1f9-a75b8df04532 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:21.525635 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-abc15fde-7175-4cf5-b1f9-a75b8df04532 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:21.525775 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 308/621] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:21 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1721 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:21.526749 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-abc15fde-7175-4cf5-b1f9-a75b8df04532 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:21.527631 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-abc15fde-7175-4cf5-b1f9-a75b8df04532 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:21.528213 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-abc15fde-7175-4cf5-b1f9-a75b8df04532 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:21.528834 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-abc15fde-7175-4cf5-b1f9-a75b8df04532 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:21.611808 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-abc15fde-7175-4cf5-b1f9-a75b8df04532 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:21.621281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-abc15fde-7175-4cf5-b1f9-a75b8df04532 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a" status: 200 len: 1298 microversion: 2.1 time: 0.116698 Sep 02 05:27:21.621845 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 314/622] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:21 2022] GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a => generated 1298 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:22.451581 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-665c8b13-63c0-4739-b41d-6ac7b60cf064 req-c4d567b5-ac1b-44d6-8bb0-05c46860b07a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "985ff518-439b-4f6e-9b9d-d83260bad8ea", "name": "network-vif-plugged", "status": "completed", "tag": "c7f90668-6146-4987-9b47-3573fe921638"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:27:22.464937 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-665c8b13-63c0-4739-b41d-6ac7b60cf064 req-c4d567b5-ac1b-44d6-8bb0-05c46860b07a service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:22.465946 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-665c8b13-63c0-4739-b41d-6ac7b60cf064 req-c4d567b5-ac1b-44d6-8bb0-05c46860b07a service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:22.467108 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-665c8b13-63c0-4739-b41d-6ac7b60cf064 req-c4d567b5-ac1b-44d6-8bb0-05c46860b07a service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:22.481977 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-665c8b13-63c0-4739-b41d-6ac7b60cf064 req-c4d567b5-ac1b-44d6-8bb0-05c46860b07a service nova] Creating event network-vif-plugged:c7f90668-6146-4987-9b47-3573fe921638 for instance 985ff518-439b-4f6e-9b9d-d83260bad8ea on hv-cinder-85391 Sep 02 05:27:22.496422 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-665c8b13-63c0-4739-b41d-6ac7b60cf064 req-c4d567b5-ac1b-44d6-8bb0-05c46860b07a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051639 Sep 02 05:27:22.498401 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 309/623] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:27:22.526043 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-25b97cde-62d7-4a9b-9b34-c48f883c56e9 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:22.527306 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-25b97cde-62d7-4a9b-9b34-c48f883c56e9 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: 985ff518-439b-4f6e-9b9d-d83260bad8ea] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:22.533942 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f554af06-479e-4215-a19f-f8b64d19ec72 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:22.534637 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f554af06-479e-4215-a19f-f8b64d19ec72 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:22.536743 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-25b97cde-62d7-4a9b-9b34-c48f883c56e9 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:22.537330 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-25b97cde-62d7-4a9b-9b34-c48f883c56e9 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:22.537851 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-25b97cde-62d7-4a9b-9b34-c48f883c56e9 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:22.538676 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-25b97cde-62d7-4a9b-9b34-c48f883c56e9 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:22.539247 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-25b97cde-62d7-4a9b-9b34-c48f883c56e9 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:22.540312 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-25b97cde-62d7-4a9b-9b34-c48f883c56e9 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:22.550862 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f554af06-479e-4215-a19f-f8b64d19ec72 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:22.551353 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f554af06-479e-4215-a19f-f8b64d19ec72 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:22.552106 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f554af06-479e-4215-a19f-f8b64d19ec72 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:22.552982 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f554af06-479e-4215-a19f-f8b64d19ec72 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:22.553426 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f554af06-479e-4215-a19f-f8b64d19ec72 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:22.555515 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f554af06-479e-4215-a19f-f8b64d19ec72 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:22.809709 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-25b97cde-62d7-4a9b-9b34-c48f883c56e9 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:22.821614 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f554af06-479e-4215-a19f-f8b64d19ec72 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:22.827881 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-25b97cde-62d7-4a9b-9b34-c48f883c56e9 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea" status: 200 len: 1318 microversion: 2.1 time: 0.307532 Sep 02 05:27:22.829402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 315/624] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:22 2022] GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:22.832845 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f554af06-479e-4215-a19f-f8b64d19ec72 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:22.834271 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f554af06-479e-4215-a19f-f8b64d19ec72 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:22.834781 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-51f63d94-7564-4751-84f4-ba548c0cdcf8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:22.835436 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f554af06-479e-4215-a19f-f8b64d19ec72 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1721 microversion: 2.20 time: 0.305918 Sep 02 05:27:22.835852 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-51f63d94-7564-4751-84f4-ba548c0cdcf8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:22.837948 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:27:22.850244 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-51f63d94-7564-4751-84f4-ba548c0cdcf8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:22.851124 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-51f63d94-7564-4751-84f4-ba548c0cdcf8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:22.851788 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-51f63d94-7564-4751-84f4-ba548c0cdcf8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:22.852682 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 310/625] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:22 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1721 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:22.853311 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-51f63d94-7564-4751-84f4-ba548c0cdcf8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:22.853965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-51f63d94-7564-4751-84f4-ba548c0cdcf8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:22.854627 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-51f63d94-7564-4751-84f4-ba548c0cdcf8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:22.868281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-5b87f579-7a33-4ed2-80ed-a80e90804f61 req-8e2a5919-adb7-4cb1-9e16-ab389ab7c5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e74e8e64-b53c-431b-bb9c-34e58ee81d9a", "tag": "873af418-880d-4d51-9eae-002944333a5c"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:27:22.883971 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-5b87f579-7a33-4ed2-80ed-a80e90804f61 req-8e2a5919-adb7-4cb1-9e16-ab389ab7c5e6 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:22.885345 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-5b87f579-7a33-4ed2-80ed-a80e90804f61 req-8e2a5919-adb7-4cb1-9e16-ab389ab7c5e6 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:22.886762 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-5b87f579-7a33-4ed2-80ed-a80e90804f61 req-8e2a5919-adb7-4cb1-9e16-ab389ab7c5e6 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:22.907272 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-5b87f579-7a33-4ed2-80ed-a80e90804f61 req-8e2a5919-adb7-4cb1-9e16-ab389ab7c5e6 service nova] Creating event network-changed:873af418-880d-4d51-9eae-002944333a5c for instance e74e8e64-b53c-431b-bb9c-34e58ee81d9a on hv-cinder-85391 Sep 02 05:27:22.913793 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-5b87f579-7a33-4ed2-80ed-a80e90804f61 req-8e2a5919-adb7-4cb1-9e16-ab389ab7c5e6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059398 Sep 02 05:27:22.915003 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 311/626] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:27:23.009013 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-51f63d94-7564-4751-84f4-ba548c0cdcf8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:23.018301 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-51f63d94-7564-4751-84f4-ba548c0cdcf8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a" status: 200 len: 1366 microversion: 2.1 time: 0.187371 Sep 02 05:27:23.018845 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 316/627] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:22 2022] GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:23.852013 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f8060de6-6549-4c4e-bc42-5c31ae1839a7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:23.852691 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f8060de6-6549-4c4e-bc42-5c31ae1839a7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: 985ff518-439b-4f6e-9b9d-d83260bad8ea] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:23.859051 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f8060de6-6549-4c4e-bc42-5c31ae1839a7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:23.859527 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f8060de6-6549-4c4e-bc42-5c31ae1839a7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:23.859951 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f8060de6-6549-4c4e-bc42-5c31ae1839a7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:23.860674 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f8060de6-6549-4c4e-bc42-5c31ae1839a7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:23.861119 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f8060de6-6549-4c4e-bc42-5c31ae1839a7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:23.861532 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f8060de6-6549-4c4e-bc42-5c31ae1839a7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:23.868899 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-2f148593-5d70-44b7-9856-ddd7022c96af tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:23.869724 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-2f148593-5d70-44b7-9856-ddd7022c96af tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:23.876800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2f148593-5d70-44b7-9856-ddd7022c96af tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:23.877405 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2f148593-5d70-44b7-9856-ddd7022c96af tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:23.877926 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2f148593-5d70-44b7-9856-ddd7022c96af tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:23.878847 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2f148593-5d70-44b7-9856-ddd7022c96af tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:23.879481 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2f148593-5d70-44b7-9856-ddd7022c96af tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:23.880219 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2f148593-5d70-44b7-9856-ddd7022c96af tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:24.064426 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f8060de6-6549-4c4e-bc42-5c31ae1839a7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:24.067598 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-2f148593-5d70-44b7-9856-ddd7022c96af tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:24.073555 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f8060de6-6549-4c4e-bc42-5c31ae1839a7 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea" status: 200 len: 1318 microversion: 2.1 time: 0.226297 Sep 02 05:27:24.074126 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 312/628] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:23 2022] GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:24.075770 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-2f148593-5d70-44b7-9856-ddd7022c96af tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:24.077329 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-2f148593-5d70-44b7-9856-ddd7022c96af tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:24.078520 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-2f148593-5d70-44b7-9856-ddd7022c96af tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1721 microversion: 2.20 time: 0.213832 Sep 02 05:27:24.078716 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-33037121-29d4-4b67-8eb3-f680fda9955d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:24.079037 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 317/629] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:23 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:24.079693 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-33037121-29d4-4b67-8eb3-f680fda9955d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:24.085839 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-33037121-29d4-4b67-8eb3-f680fda9955d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:24.086282 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-33037121-29d4-4b67-8eb3-f680fda9955d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:24.086986 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-33037121-29d4-4b67-8eb3-f680fda9955d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:24.087678 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-33037121-29d4-4b67-8eb3-f680fda9955d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:24.088142 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-33037121-29d4-4b67-8eb3-f680fda9955d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:24.088568 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-33037121-29d4-4b67-8eb3-f680fda9955d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:24.226316 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-33037121-29d4-4b67-8eb3-f680fda9955d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:24.235507 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-33037121-29d4-4b67-8eb3-f680fda9955d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a" status: 200 len: 1366 microversion: 2.1 time: 0.160434 Sep 02 05:27:24.236060 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 313/630] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:24 2022] GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:25.095837 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-56703861-b1d5-4bf8-888a-6dec3f19f102 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:25.096463 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-56703861-b1d5-4bf8-888a-6dec3f19f102 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: 985ff518-439b-4f6e-9b9d-d83260bad8ea] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:25.101431 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-c6b756bf-e7f9-4cee-a7d4-da03b024a104 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:25.102063 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-c6b756bf-e7f9-4cee-a7d4-da03b024a104 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:25.103383 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-56703861-b1d5-4bf8-888a-6dec3f19f102 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:25.103895 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-56703861-b1d5-4bf8-888a-6dec3f19f102 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:25.104397 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-56703861-b1d5-4bf8-888a-6dec3f19f102 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:25.105128 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-56703861-b1d5-4bf8-888a-6dec3f19f102 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:25.105601 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-56703861-b1d5-4bf8-888a-6dec3f19f102 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:25.106049 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-56703861-b1d5-4bf8-888a-6dec3f19f102 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:25.109688 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c6b756bf-e7f9-4cee-a7d4-da03b024a104 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:25.110210 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c6b756bf-e7f9-4cee-a7d4-da03b024a104 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:25.110662 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c6b756bf-e7f9-4cee-a7d4-da03b024a104 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:25.111382 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c6b756bf-e7f9-4cee-a7d4-da03b024a104 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:25.112140 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c6b756bf-e7f9-4cee-a7d4-da03b024a104 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:25.112588 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c6b756bf-e7f9-4cee-a7d4-da03b024a104 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:25.316665 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c6b756bf-e7f9-4cee-a7d4-da03b024a104 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:25.319665 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-56703861-b1d5-4bf8-888a-6dec3f19f102 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:25.324984 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c6b756bf-e7f9-4cee-a7d4-da03b024a104 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:25.326427 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c6b756bf-e7f9-4cee-a7d4-da03b024a104 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:25.327568 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-c6b756bf-e7f9-4cee-a7d4-da03b024a104 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1721 microversion: 2.20 time: 0.230329 Sep 02 05:27:25.327875 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-56703861-b1d5-4bf8-888a-6dec3f19f102 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea" status: 200 len: 1318 microversion: 2.1 time: 0.236133 Sep 02 05:27:25.328136 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 314/631] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:25 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:25.328661 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 318/632] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:25 2022] GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:25.332515 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-0d2027e4-22de-4342-832e-6b83873ef015 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:25.333133 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-0d2027e4-22de-4342-832e-6b83873ef015 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:25.338837 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0d2027e4-22de-4342-832e-6b83873ef015 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:25.339316 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0d2027e4-22de-4342-832e-6b83873ef015 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:25.339749 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0d2027e4-22de-4342-832e-6b83873ef015 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:25.340470 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0d2027e4-22de-4342-832e-6b83873ef015 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:25.341029 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0d2027e4-22de-4342-832e-6b83873ef015 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:25.341459 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0d2027e4-22de-4342-832e-6b83873ef015 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:25.470619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-0d2027e4-22de-4342-832e-6b83873ef015 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:25.478377 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-0d2027e4-22de-4342-832e-6b83873ef015 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a" status: 200 len: 1366 microversion: 2.1 time: 0.149256 Sep 02 05:27:25.478942 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 315/633] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:25 2022] GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:26.349806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-e639ee68-ecd6-4cfd-9c69-09c1fade7628 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:26.350388 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-e639ee68-ecd6-4cfd-9c69-09c1fade7628 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: 985ff518-439b-4f6e-9b9d-d83260bad8ea] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:26.350892 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-483c4ad5-0b4e-4829-be11-2c4607c953e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:26.351510 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-483c4ad5-0b4e-4829-be11-2c4607c953e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:26.356632 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e639ee68-ecd6-4cfd-9c69-09c1fade7628 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:26.357408 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e639ee68-ecd6-4cfd-9c69-09c1fade7628 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:26.357808 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e639ee68-ecd6-4cfd-9c69-09c1fade7628 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:26.358171 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-483c4ad5-0b4e-4829-be11-2c4607c953e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:26.358672 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e639ee68-ecd6-4cfd-9c69-09c1fade7628 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:26.358821 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-483c4ad5-0b4e-4829-be11-2c4607c953e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:26.359139 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e639ee68-ecd6-4cfd-9c69-09c1fade7628 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:26.359275 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-483c4ad5-0b4e-4829-be11-2c4607c953e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:26.359521 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e639ee68-ecd6-4cfd-9c69-09c1fade7628 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:26.360017 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-483c4ad5-0b4e-4829-be11-2c4607c953e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:26.360530 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-483c4ad5-0b4e-4829-be11-2c4607c953e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:26.360938 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-483c4ad5-0b4e-4829-be11-2c4607c953e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:26.561353 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-483c4ad5-0b4e-4829-be11-2c4607c953e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:26.565551 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e639ee68-ecd6-4cfd-9c69-09c1fade7628 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:26.569748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-483c4ad5-0b4e-4829-be11-2c4607c953e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:26.571193 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-483c4ad5-0b4e-4829-be11-2c4607c953e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:26.572416 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-483c4ad5-0b4e-4829-be11-2c4607c953e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1742 microversion: 2.20 time: 0.225739 Sep 02 05:27:26.572952 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 316/634] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:26 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1742 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:27:26.573285 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-e639ee68-ecd6-4cfd-9c69-09c1fade7628 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea" status: 200 len: 1318 microversion: 2.1 time: 0.228072 Sep 02 05:27:26.574030 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 319/635] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:26 2022] GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:26.578027 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-b601c708-8176-4f49-8332-3013a9f76aab tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:26.578664 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-b601c708-8176-4f49-8332-3013a9f76aab tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:26.584718 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b601c708-8176-4f49-8332-3013a9f76aab tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:26.585252 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b601c708-8176-4f49-8332-3013a9f76aab tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:26.585705 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b601c708-8176-4f49-8332-3013a9f76aab tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:26.586386 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b601c708-8176-4f49-8332-3013a9f76aab tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:26.586836 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b601c708-8176-4f49-8332-3013a9f76aab tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:26.587344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b601c708-8176-4f49-8332-3013a9f76aab tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:26.717863 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-b601c708-8176-4f49-8332-3013a9f76aab tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:26.726046 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-b601c708-8176-4f49-8332-3013a9f76aab tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a" status: 200 len: 1366 microversion: 2.1 time: 0.152068 Sep 02 05:27:26.726613 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 317/636] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:26 2022] GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:27.595349 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-a635b4f1-5f53-4da4-a7c0-5651bbce0650 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:27.595957 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-a635b4f1-5f53-4da4-a7c0-5651bbce0650 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: 985ff518-439b-4f6e-9b9d-d83260bad8ea] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:27.596096 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-fd3ad62b-1810-402b-9647-60dca63bbef7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:27.596739 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-fd3ad62b-1810-402b-9647-60dca63bbef7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:27.602346 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a635b4f1-5f53-4da4-a7c0-5651bbce0650 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:27.602831 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a635b4f1-5f53-4da4-a7c0-5651bbce0650 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:27.603265 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a635b4f1-5f53-4da4-a7c0-5651bbce0650 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:27.603415 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fd3ad62b-1810-402b-9647-60dca63bbef7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:27.603820 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fd3ad62b-1810-402b-9647-60dca63bbef7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:27.603930 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a635b4f1-5f53-4da4-a7c0-5651bbce0650 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:27.604285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fd3ad62b-1810-402b-9647-60dca63bbef7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:27.604400 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a635b4f1-5f53-4da4-a7c0-5651bbce0650 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:27.604819 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a635b4f1-5f53-4da4-a7c0-5651bbce0650 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:27.604976 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fd3ad62b-1810-402b-9647-60dca63bbef7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:27.605423 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fd3ad62b-1810-402b-9647-60dca63bbef7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:27.605827 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fd3ad62b-1810-402b-9647-60dca63bbef7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:27.797556 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-a635b4f1-5f53-4da4-a7c0-5651bbce0650 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:27.800732 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-fd3ad62b-1810-402b-9647-60dca63bbef7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:27.805619 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-a635b4f1-5f53-4da4-a7c0-5651bbce0650 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea" status: 200 len: 1318 microversion: 2.1 time: 0.214150 Sep 02 05:27:27.806187 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 320/637] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:27 2022] GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:27.809088 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-fd3ad62b-1810-402b-9647-60dca63bbef7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:27.810477 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-fd3ad62b-1810-402b-9647-60dca63bbef7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:27.811040 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-76343aba-8365-4dbe-8a35-59ac4e693cb8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:27.811636 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-76343aba-8365-4dbe-8a35-59ac4e693cb8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:27.811781 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-fd3ad62b-1810-402b-9647-60dca63bbef7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1742 microversion: 2.20 time: 0.219306 Sep 02 05:27:27.812352 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 318/638] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:27 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1742 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:27.817675 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-76343aba-8365-4dbe-8a35-59ac4e693cb8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:27.818156 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-76343aba-8365-4dbe-8a35-59ac4e693cb8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:27.818582 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-76343aba-8365-4dbe-8a35-59ac4e693cb8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:27.819262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-76343aba-8365-4dbe-8a35-59ac4e693cb8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:27.819708 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-76343aba-8365-4dbe-8a35-59ac4e693cb8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:27.820111 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-76343aba-8365-4dbe-8a35-59ac4e693cb8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:27.955585 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-76343aba-8365-4dbe-8a35-59ac4e693cb8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:27.963420 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-76343aba-8365-4dbe-8a35-59ac4e693cb8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a" status: 200 len: 1366 microversion: 2.1 time: 0.156110 Sep 02 05:27:27.963990 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 321/639] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:27 2022] GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:28.458107 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-812e0c35-9b53-4aa3-9ac0-e40c63414bf4 req-6442257e-b61c-4b98-a0b0-b7d3c7fe1b98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e32b402-d6f2-4861-a864-005e1a9f808d", "name": "network-vif-plugged", "status": "completed", "tag": "26f374c2-ecf9-4064-b5ad-13f47d97521e"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:27:28.468632 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-812e0c35-9b53-4aa3-9ac0-e40c63414bf4 req-6442257e-b61c-4b98-a0b0-b7d3c7fe1b98 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:28.469212 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-812e0c35-9b53-4aa3-9ac0-e40c63414bf4 req-6442257e-b61c-4b98-a0b0-b7d3c7fe1b98 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:28.469525 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-812e0c35-9b53-4aa3-9ac0-e40c63414bf4 req-6442257e-b61c-4b98-a0b0-b7d3c7fe1b98 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:28.480396 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-812e0c35-9b53-4aa3-9ac0-e40c63414bf4 req-6442257e-b61c-4b98-a0b0-b7d3c7fe1b98 service nova] Creating event network-vif-plugged:26f374c2-ecf9-4064-b5ad-13f47d97521e for instance 1e32b402-d6f2-4861-a864-005e1a9f808d on hv-cinder-85391 Sep 02 05:27:28.485453 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-812e0c35-9b53-4aa3-9ac0-e40c63414bf4 req-6442257e-b61c-4b98-a0b0-b7d3c7fe1b98 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031042 Sep 02 05:27:28.486236 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 319/640] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:27:28.829036 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-37ca968a-98e6-4485-825c-e13a68274525 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:28.829934 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-37ca968a-98e6-4485-825c-e13a68274525 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: 985ff518-439b-4f6e-9b9d-d83260bad8ea] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:28.835511 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-b5c5e4c9-49f2-4d1c-aa37-4e9c6d661926 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:28.836779 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-b5c5e4c9-49f2-4d1c-aa37-4e9c6d661926 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:28.837566 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-37ca968a-98e6-4485-825c-e13a68274525 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:28.838051 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-37ca968a-98e6-4485-825c-e13a68274525 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:28.838477 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-37ca968a-98e6-4485-825c-e13a68274525 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:28.839163 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-37ca968a-98e6-4485-825c-e13a68274525 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:28.839604 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-37ca968a-98e6-4485-825c-e13a68274525 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:28.840023 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-37ca968a-98e6-4485-825c-e13a68274525 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:28.843095 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b5c5e4c9-49f2-4d1c-aa37-4e9c6d661926 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:28.843580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b5c5e4c9-49f2-4d1c-aa37-4e9c6d661926 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:28.844009 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b5c5e4c9-49f2-4d1c-aa37-4e9c6d661926 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:28.844766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b5c5e4c9-49f2-4d1c-aa37-4e9c6d661926 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:28.845221 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b5c5e4c9-49f2-4d1c-aa37-4e9c6d661926 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:28.845642 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b5c5e4c9-49f2-4d1c-aa37-4e9c6d661926 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:29.034823 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-37ca968a-98e6-4485-825c-e13a68274525 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:29.038010 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-b5c5e4c9-49f2-4d1c-aa37-4e9c6d661926 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:29.042762 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-37ca968a-98e6-4485-825c-e13a68274525 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea" status: 200 len: 1318 microversion: 2.1 time: 0.218956 Sep 02 05:27:29.043644 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 322/641] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:28 2022] GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:29.047889 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-9a9a8ace-f2d6-456e-8213-ae84250efc6d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:29.048580 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-9a9a8ace-f2d6-456e-8213-ae84250efc6d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:29.052273 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-b5c5e4c9-49f2-4d1c-aa37-4e9c6d661926 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:29.053702 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-b5c5e4c9-49f2-4d1c-aa37-4e9c6d661926 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:29.054687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9a9a8ace-f2d6-456e-8213-ae84250efc6d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:29.054849 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-b5c5e4c9-49f2-4d1c-aa37-4e9c6d661926 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1742 microversion: 2.20 time: 0.224022 Sep 02 05:27:29.055210 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9a9a8ace-f2d6-456e-8213-ae84250efc6d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:29.055639 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 320/642] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:28 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1742 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:29.055776 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9a9a8ace-f2d6-456e-8213-ae84250efc6d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:29.056384 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9a9a8ace-f2d6-456e-8213-ae84250efc6d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:29.056837 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9a9a8ace-f2d6-456e-8213-ae84250efc6d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:29.057258 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9a9a8ace-f2d6-456e-8213-ae84250efc6d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:29.192837 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-9a9a8ace-f2d6-456e-8213-ae84250efc6d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:29.200630 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-9a9a8ace-f2d6-456e-8213-ae84250efc6d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a" status: 200 len: 1366 microversion: 2.1 time: 0.156168 Sep 02 05:27:29.201186 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 323/643] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:29 2022] GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:30.064080 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-715b5b6a-55f3-451d-bfe6-d6d808d02da8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:30.064666 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-715b5b6a-55f3-451d-bfe6-d6d808d02da8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: 985ff518-439b-4f6e-9b9d-d83260bad8ea] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:30.066798 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell0:SELECT=2 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:27:30.067411 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell0:SELECT=6 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:27:30.074778 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-715b5b6a-55f3-451d-bfe6-d6d808d02da8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:30.075333 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-715b5b6a-55f3-451d-bfe6-d6d808d02da8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:30.075738 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-715b5b6a-55f3-451d-bfe6-d6d808d02da8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:30.076703 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-715b5b6a-55f3-451d-bfe6-d6d808d02da8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:30.077133 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-715b5b6a-55f3-451d-bfe6-d6d808d02da8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:30.077722 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-715b5b6a-55f3-451d-bfe6-d6d808d02da8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:30.080613 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-15f5891d-738b-476a-9e7e-4ddacb67fb3f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:30.081369 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-15f5891d-738b-476a-9e7e-4ddacb67fb3f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:30.083442 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell0:SELECT=6 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:27:30.089222 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-15f5891d-738b-476a-9e7e-4ddacb67fb3f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:30.090422 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-15f5891d-738b-476a-9e7e-4ddacb67fb3f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:30.090920 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-15f5891d-738b-476a-9e7e-4ddacb67fb3f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:30.091839 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-15f5891d-738b-476a-9e7e-4ddacb67fb3f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:30.092581 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-15f5891d-738b-476a-9e7e-4ddacb67fb3f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:30.093315 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-15f5891d-738b-476a-9e7e-4ddacb67fb3f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:30.380404 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-715b5b6a-55f3-451d-bfe6-d6d808d02da8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:30.390273 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-15f5891d-738b-476a-9e7e-4ddacb67fb3f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:30.392785 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-715b5b6a-55f3-451d-bfe6-d6d808d02da8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea" status: 200 len: 1507 microversion: 2.1 time: 0.329698 Sep 02 05:27:30.393753 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 321/644] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:30 2022] GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea => generated 1507 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:30.398532 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-0360cb31-b049-472b-9cdb-777501d02096 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:30.399432 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-0360cb31-b049-472b-9cdb-777501d02096 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:30.401794 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:27:30.409336 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0360cb31-b049-472b-9cdb-777501d02096 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:30.410183 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0360cb31-b049-472b-9cdb-777501d02096 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:30.410834 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0360cb31-b049-472b-9cdb-777501d02096 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:30.412066 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0360cb31-b049-472b-9cdb-777501d02096 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:30.412782 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0360cb31-b049-472b-9cdb-777501d02096 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:30.413420 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0360cb31-b049-472b-9cdb-777501d02096 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:30.415153 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-15f5891d-738b-476a-9e7e-4ddacb67fb3f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:30.417262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-15f5891d-738b-476a-9e7e-4ddacb67fb3f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:30.418754 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-15f5891d-738b-476a-9e7e-4ddacb67fb3f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1742 microversion: 2.20 time: 0.343073 Sep 02 05:27:30.420219 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 324/645] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:30 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1742 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:30.427778 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-87ae7ee9-ded3-42b3-bf2c-0b5874f3f066 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8fe21ebb-25ec-4a8f-8035-781995eebcee", "device": "/dev/sdb"}} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:27:30.430776 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-87ae7ee9-ded3-42b3-bf2c-0b5874f3f066 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: 985ff518-439b-4f6e-9b9d-d83260bad8ea] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:30.438619 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-87ae7ee9-ded3-42b3-bf2c-0b5874f3f066 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:30.439780 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-87ae7ee9-ded3-42b3-bf2c-0b5874f3f066 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:30.440264 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-87ae7ee9-ded3-42b3-bf2c-0b5874f3f066 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:30.440962 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-87ae7ee9-ded3-42b3-bf2c-0b5874f3f066 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:30.441416 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-87ae7ee9-ded3-42b3-bf2c-0b5874f3f066 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:30.442099 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-87ae7ee9-ded3-42b3-bf2c-0b5874f3f066 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:30.631170 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-0360cb31-b049-472b-9cdb-777501d02096 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:30.639536 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-0360cb31-b049-472b-9cdb-777501d02096 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a" status: 200 len: 1366 microversion: 2.1 time: 0.244698 Sep 02 05:27:30.640496 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 322/646] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:30 2022] GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:30.781234 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-87ae7ee9-ded3-42b3-bf2c-0b5874f3f066 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "POST /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.357806 Sep 02 05:27:30.782047 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 325/647] 10.222.0.30 () {60 vars in 1323 bytes} [Fri Sep 2 05:27:30 2022] POST /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea/os-volume_attachments => generated 194 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:27:31.446175 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-329c05fb-70b7-444d-8a3a-f2f894e537a0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:31.447033 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-329c05fb-70b7-444d-8a3a-f2f894e537a0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:31.455796 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-329c05fb-70b7-444d-8a3a-f2f894e537a0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:31.456322 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-329c05fb-70b7-444d-8a3a-f2f894e537a0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:31.456757 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-329c05fb-70b7-444d-8a3a-f2f894e537a0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:31.457440 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-329c05fb-70b7-444d-8a3a-f2f894e537a0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:31.457898 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-329c05fb-70b7-444d-8a3a-f2f894e537a0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:31.458325 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-329c05fb-70b7-444d-8a3a-f2f894e537a0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:31.590604 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-329c05fb-70b7-444d-8a3a-f2f894e537a0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:31.599146 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-329c05fb-70b7-444d-8a3a-f2f894e537a0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:31.600643 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-329c05fb-70b7-444d-8a3a-f2f894e537a0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:31.602165 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-329c05fb-70b7-444d-8a3a-f2f894e537a0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1742 microversion: 2.20 time: 0.162428 Sep 02 05:27:31.602490 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 323/648] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:31 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1742 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:31.662534 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-92be6ebe-e8c9-4670-9a5d-084b0c8da863 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:31.663226 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-92be6ebe-e8c9-4670-9a5d-084b0c8da863 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:31.670383 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-92be6ebe-e8c9-4670-9a5d-084b0c8da863 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:31.670863 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-92be6ebe-e8c9-4670-9a5d-084b0c8da863 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:31.671287 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-92be6ebe-e8c9-4670-9a5d-084b0c8da863 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:31.671968 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-92be6ebe-e8c9-4670-9a5d-084b0c8da863 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:31.672449 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-92be6ebe-e8c9-4670-9a5d-084b0c8da863 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:31.672848 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-92be6ebe-e8c9-4670-9a5d-084b0c8da863 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:31.809890 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-92be6ebe-e8c9-4670-9a5d-084b0c8da863 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:31.817733 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-92be6ebe-e8c9-4670-9a5d-084b0c8da863 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a" status: 200 len: 1366 microversion: 2.1 time: 0.159980 Sep 02 05:27:31.818315 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 326/649] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:31 2022] GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:32.627320 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-eaf3b36d-4379-4039-9705-13cc0db56899 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:32.627937 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-eaf3b36d-4379-4039-9705-13cc0db56899 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:32.635752 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eaf3b36d-4379-4039-9705-13cc0db56899 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:32.636246 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eaf3b36d-4379-4039-9705-13cc0db56899 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:32.636679 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eaf3b36d-4379-4039-9705-13cc0db56899 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:32.637406 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eaf3b36d-4379-4039-9705-13cc0db56899 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:32.637860 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eaf3b36d-4379-4039-9705-13cc0db56899 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:32.638281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eaf3b36d-4379-4039-9705-13cc0db56899 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:32.772900 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-eaf3b36d-4379-4039-9705-13cc0db56899 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:32.781323 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-eaf3b36d-4379-4039-9705-13cc0db56899 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:32.782788 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-eaf3b36d-4379-4039-9705-13cc0db56899 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:32.784024 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-eaf3b36d-4379-4039-9705-13cc0db56899 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1742 microversion: 2.20 time: 0.161683 Sep 02 05:27:32.784612 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 324/650] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:32 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1742 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:32.839016 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-2b9a69bf-c08f-4aa0-bb6f-6eb2b77993f8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:32.839570 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-2b9a69bf-c08f-4aa0-bb6f-6eb2b77993f8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:32.846768 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2b9a69bf-c08f-4aa0-bb6f-6eb2b77993f8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:32.847269 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2b9a69bf-c08f-4aa0-bb6f-6eb2b77993f8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:32.847702 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2b9a69bf-c08f-4aa0-bb6f-6eb2b77993f8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:32.848407 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2b9a69bf-c08f-4aa0-bb6f-6eb2b77993f8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:32.848913 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2b9a69bf-c08f-4aa0-bb6f-6eb2b77993f8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:32.849335 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2b9a69bf-c08f-4aa0-bb6f-6eb2b77993f8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:32.864693 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:27:32.987229 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-2b9a69bf-c08f-4aa0-bb6f-6eb2b77993f8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:32.995826 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-2b9a69bf-c08f-4aa0-bb6f-6eb2b77993f8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a" status: 200 len: 1366 microversion: 2.1 time: 0.160714 Sep 02 05:27:33.004402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 327/651] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:32 2022] GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:33.681920 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-037b3967-cc9a-41ea-bcb1-8e7cd305bf1f req-f2a2d554-647f-4a3d-a6af-cf361777eb53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e74e8e64-b53c-431b-bb9c-34e58ee81d9a", "name": "network-vif-plugged", "status": "completed", "tag": "873af418-880d-4d51-9eae-002944333a5c"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:27:33.692613 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-037b3967-cc9a-41ea-bcb1-8e7cd305bf1f req-f2a2d554-647f-4a3d-a6af-cf361777eb53 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:33.693087 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-037b3967-cc9a-41ea-bcb1-8e7cd305bf1f req-f2a2d554-647f-4a3d-a6af-cf361777eb53 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:33.693510 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-037b3967-cc9a-41ea-bcb1-8e7cd305bf1f req-f2a2d554-647f-4a3d-a6af-cf361777eb53 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:33.704901 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-037b3967-cc9a-41ea-bcb1-8e7cd305bf1f req-f2a2d554-647f-4a3d-a6af-cf361777eb53 service nova] Creating event network-vif-plugged:873af418-880d-4d51-9eae-002944333a5c for instance e74e8e64-b53c-431b-bb9c-34e58ee81d9a on hv-cinder-85391 Sep 02 05:27:33.709870 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-037b3967-cc9a-41ea-bcb1-8e7cd305bf1f req-f2a2d554-647f-4a3d-a6af-cf361777eb53 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031690 Sep 02 05:27:33.710469 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 325/652] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:27:33.806998 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-8f191d54-a4c6-49d0-b14f-079a96bf8711 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:33.807501 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-8f191d54-a4c6-49d0-b14f-079a96bf8711 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:33.814138 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8f191d54-a4c6-49d0-b14f-079a96bf8711 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:33.814607 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8f191d54-a4c6-49d0-b14f-079a96bf8711 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:33.815035 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8f191d54-a4c6-49d0-b14f-079a96bf8711 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:33.815704 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8f191d54-a4c6-49d0-b14f-079a96bf8711 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:33.816134 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8f191d54-a4c6-49d0-b14f-079a96bf8711 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:33.816587 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8f191d54-a4c6-49d0-b14f-079a96bf8711 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:33.985317 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-8f191d54-a4c6-49d0-b14f-079a96bf8711 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:33.995360 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-8f191d54-a4c6-49d0-b14f-079a96bf8711 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:33.997045 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-8f191d54-a4c6-49d0-b14f-079a96bf8711 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:33.998626 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-8f191d54-a4c6-49d0-b14f-079a96bf8711 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1742 microversion: 2.20 time: 0.195535 Sep 02 05:27:33.999342 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 328/653] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:33 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1742 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:34.021070 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-405518a4-a837-4214-ac45-482999dadd14 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:34.021574 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-405518a4-a837-4214-ac45-482999dadd14 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:34.027801 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-405518a4-a837-4214-ac45-482999dadd14 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:34.028427 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-405518a4-a837-4214-ac45-482999dadd14 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:34.028951 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-405518a4-a837-4214-ac45-482999dadd14 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:34.031689 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-405518a4-a837-4214-ac45-482999dadd14 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:34.032249 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-405518a4-a837-4214-ac45-482999dadd14 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:34.032678 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-405518a4-a837-4214-ac45-482999dadd14 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:34.036938 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=100 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:27:34.173207 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-405518a4-a837-4214-ac45-482999dadd14 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:34.181273 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-405518a4-a837-4214-ac45-482999dadd14 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a" status: 200 len: 1366 microversion: 2.1 time: 0.165213 Sep 02 05:27:34.181842 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 326/654] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:34 2022] GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:35.023431 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ca3b5a87-eaae-4191-9be1-cb03faec5e32 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:35.024082 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-ca3b5a87-eaae-4191-9be1-cb03faec5e32 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:35.031972 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ca3b5a87-eaae-4191-9be1-cb03faec5e32 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:35.033809 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ca3b5a87-eaae-4191-9be1-cb03faec5e32 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:35.033809 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ca3b5a87-eaae-4191-9be1-cb03faec5e32 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:35.033809 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ca3b5a87-eaae-4191-9be1-cb03faec5e32 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:35.034099 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ca3b5a87-eaae-4191-9be1-cb03faec5e32 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:35.034478 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ca3b5a87-eaae-4191-9be1-cb03faec5e32 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:35.171622 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ca3b5a87-eaae-4191-9be1-cb03faec5e32 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:35.184453 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ca3b5a87-eaae-4191-9be1-cb03faec5e32 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:35.186338 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ca3b5a87-eaae-4191-9be1-cb03faec5e32 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:35.187627 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-ca3b5a87-eaae-4191-9be1-cb03faec5e32 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1742 microversion: 2.20 time: 0.169195 Sep 02 05:27:35.188252 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 329/655] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:35 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1742 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:35.202165 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-a6daf58c-a7de-4b29-b26f-fe9437070161 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:35.202773 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-a6daf58c-a7de-4b29-b26f-fe9437070161 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:35.209936 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a6daf58c-a7de-4b29-b26f-fe9437070161 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:35.210491 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a6daf58c-a7de-4b29-b26f-fe9437070161 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:35.210843 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a6daf58c-a7de-4b29-b26f-fe9437070161 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:35.211673 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a6daf58c-a7de-4b29-b26f-fe9437070161 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:35.212109 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a6daf58c-a7de-4b29-b26f-fe9437070161 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:35.212606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a6daf58c-a7de-4b29-b26f-fe9437070161 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:35.365740 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-a6daf58c-a7de-4b29-b26f-fe9437070161 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:35.378010 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-a6daf58c-a7de-4b29-b26f-fe9437070161 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a" status: 200 len: 1366 microversion: 2.1 time: 0.179625 Sep 02 05:27:35.378752 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 327/656] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:35 2022] GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:36.215772 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-05e43cc7-a925-4f0d-90b5-6a13b7f8eff2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:36.216891 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-05e43cc7-a925-4f0d-90b5-6a13b7f8eff2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:36.228603 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-05e43cc7-a925-4f0d-90b5-6a13b7f8eff2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:36.229406 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-05e43cc7-a925-4f0d-90b5-6a13b7f8eff2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:36.230121 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-05e43cc7-a925-4f0d-90b5-6a13b7f8eff2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:36.231248 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-05e43cc7-a925-4f0d-90b5-6a13b7f8eff2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:36.232004 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-05e43cc7-a925-4f0d-90b5-6a13b7f8eff2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:36.232670 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-05e43cc7-a925-4f0d-90b5-6a13b7f8eff2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:36.366481 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-05e43cc7-a925-4f0d-90b5-6a13b7f8eff2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:36.374857 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-05e43cc7-a925-4f0d-90b5-6a13b7f8eff2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:36.376330 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-05e43cc7-a925-4f0d-90b5-6a13b7f8eff2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:36.377486 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-05e43cc7-a925-4f0d-90b5-6a13b7f8eff2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1742 microversion: 2.20 time: 0.169464 Sep 02 05:27:36.378270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 330/657] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:36 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1742 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:36.401572 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-99539bec-7132-4a3a-84f1-3c9648fb684a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:36.402146 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-99539bec-7132-4a3a-84f1-3c9648fb684a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:36.409415 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-99539bec-7132-4a3a-84f1-3c9648fb684a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:36.409891 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-99539bec-7132-4a3a-84f1-3c9648fb684a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:36.410315 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-99539bec-7132-4a3a-84f1-3c9648fb684a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:36.411006 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-99539bec-7132-4a3a-84f1-3c9648fb684a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:36.411442 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-99539bec-7132-4a3a-84f1-3c9648fb684a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:36.411858 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-99539bec-7132-4a3a-84f1-3c9648fb684a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:36.540089 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-99539bec-7132-4a3a-84f1-3c9648fb684a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:36.551294 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-99539bec-7132-4a3a-84f1-3c9648fb684a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a" status: 200 len: 1366 microversion: 2.1 time: 0.155613 Sep 02 05:27:36.552189 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 328/658] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:36 2022] GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:37.409446 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-41cee865-5b0f-4a7d-b93c-d3d3dcd8dc48 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:37.410305 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-41cee865-5b0f-4a7d-b93c-d3d3dcd8dc48 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:37.420947 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-41cee865-5b0f-4a7d-b93c-d3d3dcd8dc48 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:37.421429 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-41cee865-5b0f-4a7d-b93c-d3d3dcd8dc48 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:37.421865 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-41cee865-5b0f-4a7d-b93c-d3d3dcd8dc48 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:37.422555 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-41cee865-5b0f-4a7d-b93c-d3d3dcd8dc48 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:37.422989 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-41cee865-5b0f-4a7d-b93c-d3d3dcd8dc48 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:37.423456 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-41cee865-5b0f-4a7d-b93c-d3d3dcd8dc48 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:37.561402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-41cee865-5b0f-4a7d-b93c-d3d3dcd8dc48 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:37.572355 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-41cee865-5b0f-4a7d-b93c-d3d3dcd8dc48 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:37.573804 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-41cee865-5b0f-4a7d-b93c-d3d3dcd8dc48 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:37.574975 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-41cee865-5b0f-4a7d-b93c-d3d3dcd8dc48 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1742 microversion: 2.20 time: 0.172402 Sep 02 05:27:37.575575 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 331/659] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:37 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1742 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:37.575742 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-a10450c6-c57e-4310-af0a-7ecc4e3ecd22 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:37.577252 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-a10450c6-c57e-4310-af0a-7ecc4e3ecd22 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:37.584134 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a10450c6-c57e-4310-af0a-7ecc4e3ecd22 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:37.584652 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a10450c6-c57e-4310-af0a-7ecc4e3ecd22 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:37.585073 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a10450c6-c57e-4310-af0a-7ecc4e3ecd22 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:37.585755 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a10450c6-c57e-4310-af0a-7ecc4e3ecd22 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:37.586275 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a10450c6-c57e-4310-af0a-7ecc4e3ecd22 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:37.586694 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a10450c6-c57e-4310-af0a-7ecc4e3ecd22 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:37.719121 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-a10450c6-c57e-4310-af0a-7ecc4e3ecd22 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:37.727151 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-a10450c6-c57e-4310-af0a-7ecc4e3ecd22 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a" status: 200 len: 1366 microversion: 2.1 time: 0.155477 Sep 02 05:27:37.727718 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 329/660] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:37 2022] GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:27:38.598382 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-1ad86d63-4204-4d15-8dc4-c2bcffc9ba06 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:38.599010 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-1ad86d63-4204-4d15-8dc4-c2bcffc9ba06 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:38.605530 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1ad86d63-4204-4d15-8dc4-c2bcffc9ba06 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:38.606004 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1ad86d63-4204-4d15-8dc4-c2bcffc9ba06 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:38.606428 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1ad86d63-4204-4d15-8dc4-c2bcffc9ba06 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:38.607126 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1ad86d63-4204-4d15-8dc4-c2bcffc9ba06 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:38.607548 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1ad86d63-4204-4d15-8dc4-c2bcffc9ba06 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:38.607963 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1ad86d63-4204-4d15-8dc4-c2bcffc9ba06 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:38.739292 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1ad86d63-4204-4d15-8dc4-c2bcffc9ba06 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:38.748237 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-38a2b79d-57c9-4c6f-bf6c-f8ae7174262b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:38.748808 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1ad86d63-4204-4d15-8dc4-c2bcffc9ba06 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:38.748924 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-38a2b79d-57c9-4c6f-bf6c-f8ae7174262b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:38.749891 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1ad86d63-4204-4d15-8dc4-c2bcffc9ba06 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:38.751049 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-1ad86d63-4204-4d15-8dc4-c2bcffc9ba06 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1742 microversion: 2.20 time: 0.156566 Sep 02 05:27:38.751574 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 332/661] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:38 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:38.755451 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-38a2b79d-57c9-4c6f-bf6c-f8ae7174262b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:38.756037 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-38a2b79d-57c9-4c6f-bf6c-f8ae7174262b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:38.756500 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-38a2b79d-57c9-4c6f-bf6c-f8ae7174262b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:38.757192 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-38a2b79d-57c9-4c6f-bf6c-f8ae7174262b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:38.757641 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-38a2b79d-57c9-4c6f-bf6c-f8ae7174262b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:38.758061 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-38a2b79d-57c9-4c6f-bf6c-f8ae7174262b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:38.890902 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-38a2b79d-57c9-4c6f-bf6c-f8ae7174262b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:38.898692 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-38a2b79d-57c9-4c6f-bf6c-f8ae7174262b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a" status: 200 len: 1366 microversion: 2.1 time: 0.154267 Sep 02 05:27:38.899256 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 330/662] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:38 2022] GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:39.774229 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-7a20c8ef-5566-4c9f-9247-c5ee3e198757 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:39.774841 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-7a20c8ef-5566-4c9f-9247-c5ee3e198757 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:39.781769 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7a20c8ef-5566-4c9f-9247-c5ee3e198757 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:39.782259 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7a20c8ef-5566-4c9f-9247-c5ee3e198757 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:39.782692 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7a20c8ef-5566-4c9f-9247-c5ee3e198757 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:39.783381 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7a20c8ef-5566-4c9f-9247-c5ee3e198757 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:39.783828 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7a20c8ef-5566-4c9f-9247-c5ee3e198757 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:39.784454 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7a20c8ef-5566-4c9f-9247-c5ee3e198757 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:39.919696 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-394a6836-22b0-488f-8770-9611c34611f6 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:39.920363 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-394a6836-22b0-488f-8770-9611c34611f6 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:39.922532 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-7a20c8ef-5566-4c9f-9247-c5ee3e198757 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:39.927302 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-394a6836-22b0-488f-8770-9611c34611f6 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:39.927822 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-394a6836-22b0-488f-8770-9611c34611f6 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:39.928258 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-394a6836-22b0-488f-8770-9611c34611f6 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:39.928959 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-394a6836-22b0-488f-8770-9611c34611f6 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:39.929403 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-394a6836-22b0-488f-8770-9611c34611f6 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:39.929821 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-394a6836-22b0-488f-8770-9611c34611f6 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:39.930910 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-7a20c8ef-5566-4c9f-9247-c5ee3e198757 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:39.932413 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-7a20c8ef-5566-4c9f-9247-c5ee3e198757 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:39.933627 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-7a20c8ef-5566-4c9f-9247-c5ee3e198757 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1742 microversion: 2.20 time: 0.163319 Sep 02 05:27:39.934181 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 333/663] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:39 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1742 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:40.062820 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-394a6836-22b0-488f-8770-9611c34611f6 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:40.070644 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-394a6836-22b0-488f-8770-9611c34611f6 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a" status: 200 len: 1366 microversion: 2.1 time: 0.154892 Sep 02 05:27:40.071213 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 331/664] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:39 2022] GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:40.961378 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-75a7671c-1a74-43e9-aea2-658810005310 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:40.962209 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-75a7671c-1a74-43e9-aea2-658810005310 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:40.971381 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-75a7671c-1a74-43e9-aea2-658810005310 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:40.971867 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-75a7671c-1a74-43e9-aea2-658810005310 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:40.972341 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-75a7671c-1a74-43e9-aea2-658810005310 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:40.973053 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-75a7671c-1a74-43e9-aea2-658810005310 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:40.973511 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-75a7671c-1a74-43e9-aea2-658810005310 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:40.973934 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-75a7671c-1a74-43e9-aea2-658810005310 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:41.091156 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-8f5add5a-1c55-48a3-aab1-36b48d88b163 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:41.091754 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-8f5add5a-1c55-48a3-aab1-36b48d88b163 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:41.098668 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8f5add5a-1c55-48a3-aab1-36b48d88b163 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:41.099162 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8f5add5a-1c55-48a3-aab1-36b48d88b163 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:41.099589 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8f5add5a-1c55-48a3-aab1-36b48d88b163 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:41.100308 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8f5add5a-1c55-48a3-aab1-36b48d88b163 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:41.100760 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8f5add5a-1c55-48a3-aab1-36b48d88b163 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:41.101174 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8f5add5a-1c55-48a3-aab1-36b48d88b163 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:41.126176 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-75a7671c-1a74-43e9-aea2-658810005310 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:41.134490 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-75a7671c-1a74-43e9-aea2-658810005310 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:41.135923 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-75a7671c-1a74-43e9-aea2-658810005310 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:41.137113 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-75a7671c-1a74-43e9-aea2-658810005310 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1742 microversion: 2.20 time: 0.182412 Sep 02 05:27:41.137680 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 334/665] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:40 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1742 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:41.238692 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-8f5add5a-1c55-48a3-aab1-36b48d88b163 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:41.248455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-8f5add5a-1c55-48a3-aab1-36b48d88b163 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a" status: 200 len: 1366 microversion: 2.1 time: 0.161198 Sep 02 05:27:41.249058 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 332/666] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:41 2022] GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:42.162187 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-b6fcfe2e-01db-4599-9249-d6db8525b898 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:42.163353 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-b6fcfe2e-01db-4599-9249-d6db8525b898 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:42.169638 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b6fcfe2e-01db-4599-9249-d6db8525b898 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:42.170242 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b6fcfe2e-01db-4599-9249-d6db8525b898 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:42.170670 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b6fcfe2e-01db-4599-9249-d6db8525b898 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:42.171360 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b6fcfe2e-01db-4599-9249-d6db8525b898 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:42.171785 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b6fcfe2e-01db-4599-9249-d6db8525b898 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:42.172350 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b6fcfe2e-01db-4599-9249-d6db8525b898 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:42.272681 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-85e5999b-b527-4a4c-8123-5e92121a6210 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:42.273286 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-85e5999b-b527-4a4c-8123-5e92121a6210 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:42.280095 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-85e5999b-b527-4a4c-8123-5e92121a6210 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:42.280604 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-85e5999b-b527-4a4c-8123-5e92121a6210 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:42.281034 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-85e5999b-b527-4a4c-8123-5e92121a6210 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:42.287139 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-85e5999b-b527-4a4c-8123-5e92121a6210 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:42.289333 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-85e5999b-b527-4a4c-8123-5e92121a6210 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:42.289878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-85e5999b-b527-4a4c-8123-5e92121a6210 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:42.345314 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-b6fcfe2e-01db-4599-9249-d6db8525b898 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:42.354465 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-b6fcfe2e-01db-4599-9249-d6db8525b898 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:42.355905 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-b6fcfe2e-01db-4599-9249-d6db8525b898 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:42.357108 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-b6fcfe2e-01db-4599-9249-d6db8525b898 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1742 microversion: 2.20 time: 0.200775 Sep 02 05:27:42.357667 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 335/667] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:42 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1742 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:42.435299 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-85e5999b-b527-4a4c-8123-5e92121a6210 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:42.444139 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-85e5999b-b527-4a4c-8123-5e92121a6210 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a" status: 200 len: 1366 microversion: 2.1 time: 0.178567 Sep 02 05:27:42.446724 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 333/668] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:42 2022] GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:27:43.383121 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-8e1a835c-d1a3-4161-bb4d-fcd192f09d4f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:43.383741 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-8e1a835c-d1a3-4161-bb4d-fcd192f09d4f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:43.390615 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8e1a835c-d1a3-4161-bb4d-fcd192f09d4f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:43.391183 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8e1a835c-d1a3-4161-bb4d-fcd192f09d4f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:43.391835 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8e1a835c-d1a3-4161-bb4d-fcd192f09d4f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:43.392559 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8e1a835c-d1a3-4161-bb4d-fcd192f09d4f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:43.393021 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8e1a835c-d1a3-4161-bb4d-fcd192f09d4f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:43.393445 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8e1a835c-d1a3-4161-bb4d-fcd192f09d4f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:43.469272 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-a7a4e06c-ac49-40fc-9c25-34361e4eebe9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:43.469864 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-a7a4e06c-ac49-40fc-9c25-34361e4eebe9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:43.476433 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a7a4e06c-ac49-40fc-9c25-34361e4eebe9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:43.476915 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a7a4e06c-ac49-40fc-9c25-34361e4eebe9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:43.477342 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a7a4e06c-ac49-40fc-9c25-34361e4eebe9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:43.478057 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a7a4e06c-ac49-40fc-9c25-34361e4eebe9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:43.478931 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a7a4e06c-ac49-40fc-9c25-34361e4eebe9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:43.478931 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a7a4e06c-ac49-40fc-9c25-34361e4eebe9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:43.558328 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-8e1a835c-d1a3-4161-bb4d-fcd192f09d4f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:43.566870 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-8e1a835c-d1a3-4161-bb4d-fcd192f09d4f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:43.568674 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-8e1a835c-d1a3-4161-bb4d-fcd192f09d4f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:43.570193 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-8e1a835c-d1a3-4161-bb4d-fcd192f09d4f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1742 microversion: 2.20 time: 0.190903 Sep 02 05:27:43.570527 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 336/669] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:43 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1742 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:43.627152 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-a7a4e06c-ac49-40fc-9c25-34361e4eebe9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:43.635113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-a7a4e06c-ac49-40fc-9c25-34361e4eebe9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a" status: 200 len: 1555 microversion: 2.1 time: 0.169844 Sep 02 05:27:43.635676 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 334/670] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:27:43 2022] GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:27:43.655574 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-c8b643c8-18c1-427a-b61d-6cd7e5032072 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:43.656075 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-c8b643c8-18c1-427a-b61d-6cd7e5032072 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:43.662198 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c8b643c8-18c1-427a-b61d-6cd7e5032072 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:43.662688 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c8b643c8-18c1-427a-b61d-6cd7e5032072 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:43.663130 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c8b643c8-18c1-427a-b61d-6cd7e5032072 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:43.663825 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c8b643c8-18c1-427a-b61d-6cd7e5032072 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:43.664517 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c8b643c8-18c1-427a-b61d-6cd7e5032072 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:43.664946 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c8b643c8-18c1-427a-b61d-6cd7e5032072 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:43.743452 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-c8b643c8-18c1-427a-b61d-6cd7e5032072 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091631 Sep 02 05:27:43.744048 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 337/671] 10.222.0.30 () {58 vars in 1275 bytes} [Fri Sep 2 05:27:43 2022] GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:27:44.592847 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-10e10aa3-7311-4f7e-bb2b-769d2b42b51e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:44.594389 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-10e10aa3-7311-4f7e-bb2b-769d2b42b51e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:44.602947 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-10e10aa3-7311-4f7e-bb2b-769d2b42b51e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:44.603424 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-10e10aa3-7311-4f7e-bb2b-769d2b42b51e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:44.604173 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-10e10aa3-7311-4f7e-bb2b-769d2b42b51e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:44.604682 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-10e10aa3-7311-4f7e-bb2b-769d2b42b51e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:44.605269 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-10e10aa3-7311-4f7e-bb2b-769d2b42b51e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:44.605863 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-10e10aa3-7311-4f7e-bb2b-769d2b42b51e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:44.967013 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-10e10aa3-7311-4f7e-bb2b-769d2b42b51e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:44.980096 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-10e10aa3-7311-4f7e-bb2b-769d2b42b51e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:44.986926 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-10e10aa3-7311-4f7e-bb2b-769d2b42b51e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:44.995833 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-10e10aa3-7311-4f7e-bb2b-769d2b42b51e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1737 microversion: 2.20 time: 0.406806 Sep 02 05:27:44.996979 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 335/672] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:44 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1737 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:45.148146 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-681442e7-0d0a-4de2-915e-f578520066fc req-29daa6a2-c04b-45ac-8a40-1b8f3e9ea74c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e74e8e64-b53c-431b-bb9c-34e58ee81d9a", "tag": "873af418-880d-4d51-9eae-002944333a5c"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:27:45.160639 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-681442e7-0d0a-4de2-915e-f578520066fc req-29daa6a2-c04b-45ac-8a40-1b8f3e9ea74c service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:45.161675 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-681442e7-0d0a-4de2-915e-f578520066fc req-29daa6a2-c04b-45ac-8a40-1b8f3e9ea74c service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:45.162603 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-681442e7-0d0a-4de2-915e-f578520066fc req-29daa6a2-c04b-45ac-8a40-1b8f3e9ea74c service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:45.175422 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-681442e7-0d0a-4de2-915e-f578520066fc req-29daa6a2-c04b-45ac-8a40-1b8f3e9ea74c service nova] Creating event network-changed:873af418-880d-4d51-9eae-002944333a5c for instance e74e8e64-b53c-431b-bb9c-34e58ee81d9a on hv-cinder-85391 Sep 02 05:27:45.183020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-681442e7-0d0a-4de2-915e-f578520066fc req-29daa6a2-c04b-45ac-8a40-1b8f3e9ea74c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039094 Sep 02 05:27:45.184389 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 338/673] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:27:46.021546 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-40c531ba-2e1b-4d94-b38f-2a45f38865fe tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:46.022701 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-40c531ba-2e1b-4d94-b38f-2a45f38865fe tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:46.032299 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-40c531ba-2e1b-4d94-b38f-2a45f38865fe tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:46.032879 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-40c531ba-2e1b-4d94-b38f-2a45f38865fe tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:46.037177 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-40c531ba-2e1b-4d94-b38f-2a45f38865fe tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:46.038163 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-40c531ba-2e1b-4d94-b38f-2a45f38865fe tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:46.038632 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-40c531ba-2e1b-4d94-b38f-2a45f38865fe tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:46.039056 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-40c531ba-2e1b-4d94-b38f-2a45f38865fe tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:46.216883 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-40c531ba-2e1b-4d94-b38f-2a45f38865fe tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:46.237081 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-40c531ba-2e1b-4d94-b38f-2a45f38865fe tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:46.238522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-40c531ba-2e1b-4d94-b38f-2a45f38865fe tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:46.239932 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-40c531ba-2e1b-4d94-b38f-2a45f38865fe tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1737 microversion: 2.20 time: 0.222294 Sep 02 05:27:46.241307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 336/674] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:46 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1737 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:47.265805 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-f20cc20a-8976-4b87-ae85-e4d3e7714ac1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:47.266853 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-f20cc20a-8976-4b87-ae85-e4d3e7714ac1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:47.274017 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f20cc20a-8976-4b87-ae85-e4d3e7714ac1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:47.274510 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f20cc20a-8976-4b87-ae85-e4d3e7714ac1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:47.275035 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f20cc20a-8976-4b87-ae85-e4d3e7714ac1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:47.275698 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f20cc20a-8976-4b87-ae85-e4d3e7714ac1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:47.276210 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f20cc20a-8976-4b87-ae85-e4d3e7714ac1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:47.276620 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f20cc20a-8976-4b87-ae85-e4d3e7714ac1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:47.428814 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-f20cc20a-8976-4b87-ae85-e4d3e7714ac1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:47.441173 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-f20cc20a-8976-4b87-ae85-e4d3e7714ac1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:47.443828 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-f20cc20a-8976-4b87-ae85-e4d3e7714ac1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:47.445821 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-f20cc20a-8976-4b87-ae85-e4d3e7714ac1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1737 microversion: 2.20 time: 0.185750 Sep 02 05:27:47.446547 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 339/675] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:47 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1737 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:48.469823 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-5661b2ce-90e0-4a80-ae02-1f9901169e7f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:48.471202 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-5661b2ce-90e0-4a80-ae02-1f9901169e7f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:48.477719 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5661b2ce-90e0-4a80-ae02-1f9901169e7f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:48.478196 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5661b2ce-90e0-4a80-ae02-1f9901169e7f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:48.478640 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5661b2ce-90e0-4a80-ae02-1f9901169e7f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:48.479456 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5661b2ce-90e0-4a80-ae02-1f9901169e7f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:48.479806 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5661b2ce-90e0-4a80-ae02-1f9901169e7f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:48.480240 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5661b2ce-90e0-4a80-ae02-1f9901169e7f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:48.635979 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-5661b2ce-90e0-4a80-ae02-1f9901169e7f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:48.644654 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-5661b2ce-90e0-4a80-ae02-1f9901169e7f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:48.646522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-5661b2ce-90e0-4a80-ae02-1f9901169e7f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:48.647785 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-5661b2ce-90e0-4a80-ae02-1f9901169e7f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1737 microversion: 2.20 time: 0.182061 Sep 02 05:27:48.648553 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 337/676] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:48 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1737 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:49.672472 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ca89235d-6bce-4e36-85d0-e3c902fc95b8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:49.673097 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-ca89235d-6bce-4e36-85d0-e3c902fc95b8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:49.680547 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ca89235d-6bce-4e36-85d0-e3c902fc95b8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:49.681354 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ca89235d-6bce-4e36-85d0-e3c902fc95b8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:49.681803 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ca89235d-6bce-4e36-85d0-e3c902fc95b8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:49.682533 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ca89235d-6bce-4e36-85d0-e3c902fc95b8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:49.682997 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ca89235d-6bce-4e36-85d0-e3c902fc95b8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:49.683429 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ca89235d-6bce-4e36-85d0-e3c902fc95b8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:49.883637 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ca89235d-6bce-4e36-85d0-e3c902fc95b8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:49.892507 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ca89235d-6bce-4e36-85d0-e3c902fc95b8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:49.894326 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ca89235d-6bce-4e36-85d0-e3c902fc95b8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:49.895814 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-ca89235d-6bce-4e36-85d0-e3c902fc95b8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1737 microversion: 2.20 time: 0.227541 Sep 02 05:27:49.908754 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 340/677] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:49 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1737 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:50.921030 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-fa06002d-230e-4d30-a089-e9a4e947aac7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:50.922402 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-fa06002d-230e-4d30-a089-e9a4e947aac7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:50.929537 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fa06002d-230e-4d30-a089-e9a4e947aac7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:50.930322 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fa06002d-230e-4d30-a089-e9a4e947aac7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:50.930839 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fa06002d-230e-4d30-a089-e9a4e947aac7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:50.931611 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fa06002d-230e-4d30-a089-e9a4e947aac7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:50.932144 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fa06002d-230e-4d30-a089-e9a4e947aac7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:50.932663 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fa06002d-230e-4d30-a089-e9a4e947aac7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:51.104552 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-fa06002d-230e-4d30-a089-e9a4e947aac7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:51.116284 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-fa06002d-230e-4d30-a089-e9a4e947aac7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:51.117296 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-fa06002d-230e-4d30-a089-e9a4e947aac7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:51.120162 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-fa06002d-230e-4d30-a089-e9a4e947aac7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1737 microversion: 2.20 time: 0.201718 Sep 02 05:27:51.120162 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 338/678] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:50 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1737 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:52.160674 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-8a0f2d0e-62e8-4dc1-98bc-8a6068534f0d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:52.161995 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-8a0f2d0e-62e8-4dc1-98bc-8a6068534f0d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:52.174818 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8a0f2d0e-62e8-4dc1-98bc-8a6068534f0d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:52.175698 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8a0f2d0e-62e8-4dc1-98bc-8a6068534f0d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:52.176728 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8a0f2d0e-62e8-4dc1-98bc-8a6068534f0d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:52.178061 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8a0f2d0e-62e8-4dc1-98bc-8a6068534f0d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:52.178663 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8a0f2d0e-62e8-4dc1-98bc-8a6068534f0d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:52.179233 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8a0f2d0e-62e8-4dc1-98bc-8a6068534f0d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:52.349010 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-8a0f2d0e-62e8-4dc1-98bc-8a6068534f0d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:52.359044 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-8a0f2d0e-62e8-4dc1-98bc-8a6068534f0d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:52.361013 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-8a0f2d0e-62e8-4dc1-98bc-8a6068534f0d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:52.362332 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-8a0f2d0e-62e8-4dc1-98bc-8a6068534f0d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1737 microversion: 2.20 time: 0.211212 Sep 02 05:27:52.362907 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 341/679] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:52 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:27:53.389708 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d32b16cf-a22d-48a7-9a85-cfdbd4028818 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:53.390514 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-d32b16cf-a22d-48a7-9a85-cfdbd4028818 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:53.400210 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d32b16cf-a22d-48a7-9a85-cfdbd4028818 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:53.400918 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d32b16cf-a22d-48a7-9a85-cfdbd4028818 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:53.401546 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d32b16cf-a22d-48a7-9a85-cfdbd4028818 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:53.402529 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d32b16cf-a22d-48a7-9a85-cfdbd4028818 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:53.403163 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d32b16cf-a22d-48a7-9a85-cfdbd4028818 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:53.403769 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d32b16cf-a22d-48a7-9a85-cfdbd4028818 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:53.540247 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d32b16cf-a22d-48a7-9a85-cfdbd4028818 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:53.549036 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d32b16cf-a22d-48a7-9a85-cfdbd4028818 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:53.550446 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d32b16cf-a22d-48a7-9a85-cfdbd4028818 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:53.551600 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-d32b16cf-a22d-48a7-9a85-cfdbd4028818 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1737 microversion: 2.20 time: 0.167518 Sep 02 05:27:53.552167 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 339/680] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:53 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:54.574582 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-4746c518-b120-4e71-b462-79f0eb251a85 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:54.575136 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-4746c518-b120-4e71-b462-79f0eb251a85 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:54.577638 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_api:SELECT=52 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:27:54.583108 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4746c518-b120-4e71-b462-79f0eb251a85 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:54.583534 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4746c518-b120-4e71-b462-79f0eb251a85 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:54.583963 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4746c518-b120-4e71-b462-79f0eb251a85 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:54.584713 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4746c518-b120-4e71-b462-79f0eb251a85 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:54.585175 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4746c518-b120-4e71-b462-79f0eb251a85 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:54.585596 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4746c518-b120-4e71-b462-79f0eb251a85 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:54.724741 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-4746c518-b120-4e71-b462-79f0eb251a85 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:54.733388 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-4746c518-b120-4e71-b462-79f0eb251a85 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:54.734921 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-4746c518-b120-4e71-b462-79f0eb251a85 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:54.736273 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-4746c518-b120-4e71-b462-79f0eb251a85 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1737 microversion: 2.20 time: 0.165454 Sep 02 05:27:54.736913 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 342/681] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:54 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:55.759531 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-640373d6-3b07-47db-af4f-39461df19afd tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:55.760151 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-640373d6-3b07-47db-af4f-39461df19afd tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:55.766987 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-640373d6-3b07-47db-af4f-39461df19afd tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:55.767554 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-640373d6-3b07-47db-af4f-39461df19afd tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:55.768183 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-640373d6-3b07-47db-af4f-39461df19afd tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:55.769115 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-640373d6-3b07-47db-af4f-39461df19afd tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:55.769562 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-640373d6-3b07-47db-af4f-39461df19afd tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:55.769979 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-640373d6-3b07-47db-af4f-39461df19afd tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:55.915243 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-640373d6-3b07-47db-af4f-39461df19afd tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:55.923628 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-640373d6-3b07-47db-af4f-39461df19afd tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:55.925097 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-640373d6-3b07-47db-af4f-39461df19afd tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:55.926275 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-640373d6-3b07-47db-af4f-39461df19afd tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1737 microversion: 2.20 time: 0.170748 Sep 02 05:27:55.926830 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 340/682] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:55 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:56.952807 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-2a496b57-131b-4633-b35c-03524c67a461 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:56.953813 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-2a496b57-131b-4633-b35c-03524c67a461 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:56.961221 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2a496b57-131b-4633-b35c-03524c67a461 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:56.961706 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2a496b57-131b-4633-b35c-03524c67a461 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:56.962135 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2a496b57-131b-4633-b35c-03524c67a461 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:56.962816 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2a496b57-131b-4633-b35c-03524c67a461 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:56.963268 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2a496b57-131b-4633-b35c-03524c67a461 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:56.963685 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2a496b57-131b-4633-b35c-03524c67a461 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:57.093938 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-2a496b57-131b-4633-b35c-03524c67a461 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:57.106044 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-2a496b57-131b-4633-b35c-03524c67a461 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:57.108452 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-2a496b57-131b-4633-b35c-03524c67a461 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:57.109806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-2a496b57-131b-4633-b35c-03524c67a461 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1737 microversion: 2.20 time: 0.163517 Sep 02 05:27:57.110125 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 343/683] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:56 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:58.133919 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-39a4b848-677f-4435-8504-10193094608a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:58.134516 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-39a4b848-677f-4435-8504-10193094608a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:58.144549 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-39a4b848-677f-4435-8504-10193094608a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:58.145052 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-39a4b848-677f-4435-8504-10193094608a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:58.145542 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-39a4b848-677f-4435-8504-10193094608a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:58.147066 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-39a4b848-677f-4435-8504-10193094608a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:58.147595 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-39a4b848-677f-4435-8504-10193094608a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:58.148224 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-39a4b848-677f-4435-8504-10193094608a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:58.283121 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-39a4b848-677f-4435-8504-10193094608a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:58.291504 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-39a4b848-677f-4435-8504-10193094608a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:58.292973 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-39a4b848-677f-4435-8504-10193094608a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:58.294144 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-39a4b848-677f-4435-8504-10193094608a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1737 microversion: 2.20 time: 0.164606 Sep 02 05:27:58.294690 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 341/684] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:58 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:27:59.330539 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-cd4b0cfb-7c4c-4c00-97d4-b1dc99e6e0f7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:27:59.331386 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-cd4b0cfb-7c4c-4c00-97d4-b1dc99e6e0f7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:27:59.338194 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cd4b0cfb-7c4c-4c00-97d4-b1dc99e6e0f7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:59.338684 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cd4b0cfb-7c4c-4c00-97d4-b1dc99e6e0f7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:59.339119 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cd4b0cfb-7c4c-4c00-97d4-b1dc99e6e0f7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:59.339813 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cd4b0cfb-7c4c-4c00-97d4-b1dc99e6e0f7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:27:59.340378 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cd4b0cfb-7c4c-4c00-97d4-b1dc99e6e0f7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:27:59.340805 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cd4b0cfb-7c4c-4c00-97d4-b1dc99e6e0f7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:27:59.545551 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-cd4b0cfb-7c4c-4c00-97d4-b1dc99e6e0f7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:59.554176 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-cd4b0cfb-7c4c-4c00-97d4-b1dc99e6e0f7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:59.555618 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-cd4b0cfb-7c4c-4c00-97d4-b1dc99e6e0f7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:27:59.556813 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-cd4b0cfb-7c4c-4c00-97d4-b1dc99e6e0f7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1719 microversion: 2.20 time: 0.230340 Sep 02 05:27:59.557371 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 344/685] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:27:59 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1719 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:00.581088 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-722aab0e-1e5d-45fc-8862-6568cae4c06d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:00.581677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-722aab0e-1e5d-45fc-8862-6568cae4c06d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:00.584465 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=40 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:00.591141 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-722aab0e-1e5d-45fc-8862-6568cae4c06d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:00.591667 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-722aab0e-1e5d-45fc-8862-6568cae4c06d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:00.592148 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-722aab0e-1e5d-45fc-8862-6568cae4c06d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:00.592923 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-722aab0e-1e5d-45fc-8862-6568cae4c06d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:00.593417 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-722aab0e-1e5d-45fc-8862-6568cae4c06d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:00.593882 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-722aab0e-1e5d-45fc-8862-6568cae4c06d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:00.731381 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-722aab0e-1e5d-45fc-8862-6568cae4c06d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:00.733645 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=100 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:00.741173 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-722aab0e-1e5d-45fc-8862-6568cae4c06d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:00.742599 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-722aab0e-1e5d-45fc-8862-6568cae4c06d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:00.743756 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-722aab0e-1e5d-45fc-8862-6568cae4c06d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1719 microversion: 2.20 time: 0.167237 Sep 02 05:28:00.744540 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 342/686] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:00 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:01.765368 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-95bad379-27a2-4b92-8140-f29f444e0e12 req-a9e2e648-b3a5-437b-9790-0d23aa5c3bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e32b402-d6f2-4861-a864-005e1a9f808d", "name": "network-vif-unplugged", "status": "completed", "tag": "26f374c2-ecf9-4064-b5ad-13f47d97521e"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:28:01.767433 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-2afa2ce4-c33d-43f1-8861-02a7dd31c07b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:01.767849 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-2afa2ce4-c33d-43f1-8861-02a7dd31c07b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:01.774792 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2afa2ce4-c33d-43f1-8861-02a7dd31c07b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:01.775297 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2afa2ce4-c33d-43f1-8861-02a7dd31c07b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:01.775710 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-95bad379-27a2-4b92-8140-f29f444e0e12 req-a9e2e648-b3a5-437b-9790-0d23aa5c3bf1 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:01.775846 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2afa2ce4-c33d-43f1-8861-02a7dd31c07b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:01.776210 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-95bad379-27a2-4b92-8140-f29f444e0e12 req-a9e2e648-b3a5-437b-9790-0d23aa5c3bf1 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:01.776436 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2afa2ce4-c33d-43f1-8861-02a7dd31c07b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:01.776710 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-95bad379-27a2-4b92-8140-f29f444e0e12 req-a9e2e648-b3a5-437b-9790-0d23aa5c3bf1 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:01.776892 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2afa2ce4-c33d-43f1-8861-02a7dd31c07b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:01.777333 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2afa2ce4-c33d-43f1-8861-02a7dd31c07b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:01.781190 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=100 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:01.788721 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-95bad379-27a2-4b92-8140-f29f444e0e12 req-a9e2e648-b3a5-437b-9790-0d23aa5c3bf1 service nova] Creating event network-vif-unplugged:26f374c2-ecf9-4064-b5ad-13f47d97521e for instance 1e32b402-d6f2-4861-a864-005e1a9f808d on hv-cinder-85391 Sep 02 05:28:01.798184 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-95bad379-27a2-4b92-8140-f29f444e0e12 req-a9e2e648-b3a5-437b-9790-0d23aa5c3bf1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036287 Sep 02 05:28:01.798731 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 345/687] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:28:01.920319 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-2afa2ce4-c33d-43f1-8861-02a7dd31c07b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:01.929268 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-2afa2ce4-c33d-43f1-8861-02a7dd31c07b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:01.930688 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-2afa2ce4-c33d-43f1-8861-02a7dd31c07b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:01.931960 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-2afa2ce4-c33d-43f1-8861-02a7dd31c07b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1719 microversion: 2.20 time: 0.168992 Sep 02 05:28:01.932745 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 343/688] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:01 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:02.021568 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-edc115f8-e75c-4339-a2d3-141b7ef52ba8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:02.022165 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-edc115f8-e75c-4339-a2d3-141b7ef52ba8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: 985ff518-439b-4f6e-9b9d-d83260bad8ea] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:02.028571 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-edc115f8-e75c-4339-a2d3-141b7ef52ba8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:02.029052 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-edc115f8-e75c-4339-a2d3-141b7ef52ba8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:02.029456 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-edc115f8-e75c-4339-a2d3-141b7ef52ba8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:02.030120 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-edc115f8-e75c-4339-a2d3-141b7ef52ba8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:02.030599 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-edc115f8-e75c-4339-a2d3-141b7ef52ba8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:02.031031 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-edc115f8-e75c-4339-a2d3-141b7ef52ba8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:02.165744 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.objects.instance [None req-edc115f8-e75c-4339-a2d3-141b7ef52ba8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lazy-loading 'services' on Instance uuid 985ff518-439b-4f6e-9b9d-d83260bad8ea {{(pid=120449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:28:02.282522 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-edc115f8-e75c-4339-a2d3-141b7ef52ba8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "DELETE /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea/os-volume_attachments/8fe21ebb-25ec-4a8f-8035-781995eebcee" status: 202 len: 0 microversion: 2.1 time: 0.265019 Sep 02 05:28:02.283102 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 346/689] 10.222.0.30 () {58 vars in 1416 bytes} [Fri Sep 2 05:28:02 2022] DELETE /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea/os-volume_attachments/8fe21ebb-25ec-4a8f-8035-781995eebcee => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:28:02.958992 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-68d5df23-f92e-4a16-b867-fed507cf61f8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:02.959536 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-68d5df23-f92e-4a16-b867-fed507cf61f8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:02.966727 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-68d5df23-f92e-4a16-b867-fed507cf61f8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:02.967282 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-68d5df23-f92e-4a16-b867-fed507cf61f8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:02.967648 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-68d5df23-f92e-4a16-b867-fed507cf61f8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:02.968516 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-68d5df23-f92e-4a16-b867-fed507cf61f8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:02.968978 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-68d5df23-f92e-4a16-b867-fed507cf61f8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:02.969578 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-68d5df23-f92e-4a16-b867-fed507cf61f8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:03.283327 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-68d5df23-f92e-4a16-b867-fed507cf61f8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:03.292012 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-68d5df23-f92e-4a16-b867-fed507cf61f8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:03.293451 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-68d5df23-f92e-4a16-b867-fed507cf61f8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:03.294614 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-68d5df23-f92e-4a16-b867-fed507cf61f8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1722 microversion: 2.20 time: 0.340064 Sep 02 05:28:03.295166 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 344/690] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:02 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1722 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:03.319622 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-8da35a17-b309-499e-bfbf-499c46d86815 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf454366-22b4-4754-af60-4a9935a3bb0d"}} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:28:03.322352 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-8da35a17-b309-499e-bfbf-499c46d86815 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:03.328793 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8da35a17-b309-499e-bfbf-499c46d86815 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:03.329281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8da35a17-b309-499e-bfbf-499c46d86815 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:03.329811 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8da35a17-b309-499e-bfbf-499c46d86815 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:03.330595 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8da35a17-b309-499e-bfbf-499c46d86815 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:03.331149 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8da35a17-b309-499e-bfbf-499c46d86815 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:03.331597 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8da35a17-b309-499e-bfbf-499c46d86815 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:03.660840 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-8da35a17-b309-499e-bfbf-499c46d86815 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "POST /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.346293 Sep 02 05:28:03.669292 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 347/691] 10.222.0.30 () {62 vars in 1364 bytes} [Fri Sep 2 05:28:03 2022] POST /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d/os-volume_attachments => generated 188 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 05:28:03.797796 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-83a65c2e-4a7b-41e5-8487-75d5d48b794f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:28:03.798381 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-83a65c2e-4a7b-41e5-8487-75d5d48b794f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:03.804813 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-83a65c2e-4a7b-41e5-8487-75d5d48b794f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:03.805300 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-83a65c2e-4a7b-41e5-8487-75d5d48b794f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:03.805732 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-83a65c2e-4a7b-41e5-8487-75d5d48b794f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:03.806440 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-83a65c2e-4a7b-41e5-8487-75d5d48b794f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:03.806895 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-83a65c2e-4a7b-41e5-8487-75d5d48b794f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:03.807294 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-83a65c2e-4a7b-41e5-8487-75d5d48b794f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:03.851335 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-83a65c2e-4a7b-41e5-8487-75d5d48b794f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120448) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 02 05:28:03.923661 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-83a65c2e-4a7b-41e5-8487-75d5d48b794f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "POST /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d/action" status: 202 len: 0 microversion: 2.20 time: 0.129566 Sep 02 05:28:03.924609 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 345/692] 10.222.0.30 () {62 vars in 1319 bytes} [Fri Sep 2 05:28:03 2022] POST /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 05:28:03.932836 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-f2f52fe1-e310-4abf-a69e-7828b7788802 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:03.933756 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-f2f52fe1-e310-4abf-a69e-7828b7788802 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:03.941240 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f2f52fe1-e310-4abf-a69e-7828b7788802 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:03.941724 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f2f52fe1-e310-4abf-a69e-7828b7788802 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:03.942285 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f2f52fe1-e310-4abf-a69e-7828b7788802 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:03.945899 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f2f52fe1-e310-4abf-a69e-7828b7788802 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:03.946413 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f2f52fe1-e310-4abf-a69e-7828b7788802 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:03.946854 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f2f52fe1-e310-4abf-a69e-7828b7788802 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:04.157933 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-f2f52fe1-e310-4abf-a69e-7828b7788802 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:04.167329 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-f2f52fe1-e310-4abf-a69e-7828b7788802 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:04.168993 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-f2f52fe1-e310-4abf-a69e-7828b7788802 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:04.170268 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-f2f52fe1-e310-4abf-a69e-7828b7788802 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1808 microversion: 2.20 time: 0.241465 Sep 02 05:28:04.170898 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 348/693] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:03 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:04.473367 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-6f559973-9026-422c-8403-78440297678e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:04.473920 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-6f559973-9026-422c-8403-78440297678e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: 985ff518-439b-4f6e-9b9d-d83260bad8ea] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:04.479903 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6f559973-9026-422c-8403-78440297678e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:04.480348 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6f559973-9026-422c-8403-78440297678e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:04.480771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6f559973-9026-422c-8403-78440297678e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:04.481448 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6f559973-9026-422c-8403-78440297678e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:04.481881 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6f559973-9026-422c-8403-78440297678e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:04.482295 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6f559973-9026-422c-8403-78440297678e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:04.510506 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-6f559973-9026-422c-8403-78440297678e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: 985ff518-439b-4f6e-9b9d-d83260bad8ea] Going to try to terminate instance {{(pid=120448) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 05:28:04.593594 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-6f559973-9026-422c-8403-78440297678e tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "DELETE /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea" status: 204 len: 0 microversion: 2.1 time: 0.124262 Sep 02 05:28:04.594464 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 346/694] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Sep 2 05:28:04 2022] DELETE /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 05:28:04.603714 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-7f81173a-5234-48b9-84c8-55c7b0938416 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:04.604358 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-7f81173a-5234-48b9-84c8-55c7b0938416 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: 985ff518-439b-4f6e-9b9d-d83260bad8ea] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:04.611178 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7f81173a-5234-48b9-84c8-55c7b0938416 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:04.611788 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7f81173a-5234-48b9-84c8-55c7b0938416 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:04.612877 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7f81173a-5234-48b9-84c8-55c7b0938416 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:04.613970 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7f81173a-5234-48b9-84c8-55c7b0938416 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:04.614432 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7f81173a-5234-48b9-84c8-55c7b0938416 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:04.614855 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7f81173a-5234-48b9-84c8-55c7b0938416 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:04.760679 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-7f81173a-5234-48b9-84c8-55c7b0938416 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:04.768670 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-7f81173a-5234-48b9-84c8-55c7b0938416 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea" status: 200 len: 1513 microversion: 2.1 time: 0.169971 Sep 02 05:28:04.769236 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 349/695] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:28:04 2022] GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:28:05.195390 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-0a06be59-a909-40aa-8b6b-772c954a83b0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:05.196086 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-0a06be59-a909-40aa-8b6b-772c954a83b0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:05.202703 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0a06be59-a909-40aa-8b6b-772c954a83b0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:05.203179 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0a06be59-a909-40aa-8b6b-772c954a83b0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:05.203616 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0a06be59-a909-40aa-8b6b-772c954a83b0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:05.204360 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0a06be59-a909-40aa-8b6b-772c954a83b0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:05.204814 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0a06be59-a909-40aa-8b6b-772c954a83b0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:05.205245 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0a06be59-a909-40aa-8b6b-772c954a83b0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:05.345188 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-0a06be59-a909-40aa-8b6b-772c954a83b0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:05.354294 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-0a06be59-a909-40aa-8b6b-772c954a83b0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:05.355752 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-0a06be59-a909-40aa-8b6b-772c954a83b0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:05.357099 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-0a06be59-a909-40aa-8b6b-772c954a83b0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1748 microversion: 2.20 time: 0.166306 Sep 02 05:28:05.357663 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 347/696] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:05 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1748 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:05.792089 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-897c40c2-ab94-4d86-897e-e89c5961e82c tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:05.792946 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-897c40c2-ab94-4d86-897e-e89c5961e82c tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: 985ff518-439b-4f6e-9b9d-d83260bad8ea] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:05.802226 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-897c40c2-ab94-4d86-897e-e89c5961e82c tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:05.802711 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-897c40c2-ab94-4d86-897e-e89c5961e82c tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:05.803137 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-897c40c2-ab94-4d86-897e-e89c5961e82c tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:05.803822 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-897c40c2-ab94-4d86-897e-e89c5961e82c tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:05.804304 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-897c40c2-ab94-4d86-897e-e89c5961e82c tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:05.804726 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-897c40c2-ab94-4d86-897e-e89c5961e82c tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:05.940233 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-897c40c2-ab94-4d86-897e-e89c5961e82c tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:05.948288 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-897c40c2-ab94-4d86-897e-e89c5961e82c tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea" status: 200 len: 1513 microversion: 2.1 time: 0.161547 Sep 02 05:28:05.948849 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 350/697] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:28:05 2022] GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:28:06.382475 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-4986e7a7-1d12-42cb-b803-cb23cbecfa34 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:06.383251 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-4986e7a7-1d12-42cb-b803-cb23cbecfa34 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:06.391312 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4986e7a7-1d12-42cb-b803-cb23cbecfa34 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:06.391814 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4986e7a7-1d12-42cb-b803-cb23cbecfa34 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:06.392276 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4986e7a7-1d12-42cb-b803-cb23cbecfa34 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:06.392984 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4986e7a7-1d12-42cb-b803-cb23cbecfa34 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:06.393433 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4986e7a7-1d12-42cb-b803-cb23cbecfa34 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:06.393854 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4986e7a7-1d12-42cb-b803-cb23cbecfa34 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:06.536143 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-4986e7a7-1d12-42cb-b803-cb23cbecfa34 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:06.547307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-4986e7a7-1d12-42cb-b803-cb23cbecfa34 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:06.548945 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-4986e7a7-1d12-42cb-b803-cb23cbecfa34 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:06.550602 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-4986e7a7-1d12-42cb-b803-cb23cbecfa34 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1748 microversion: 2.20 time: 0.173358 Sep 02 05:28:06.551389 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 348/698] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:06 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1748 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:06.973324 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-2316b8e8-61b9-4a12-9afd-4aa7b2961124 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:06.974158 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-2316b8e8-61b9-4a12-9afd-4aa7b2961124 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: 985ff518-439b-4f6e-9b9d-d83260bad8ea] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:06.985184 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2316b8e8-61b9-4a12-9afd-4aa7b2961124 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:06.985984 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2316b8e8-61b9-4a12-9afd-4aa7b2961124 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:06.986719 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2316b8e8-61b9-4a12-9afd-4aa7b2961124 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:06.987857 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2316b8e8-61b9-4a12-9afd-4aa7b2961124 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:06.988675 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2316b8e8-61b9-4a12-9afd-4aa7b2961124 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:06.989387 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2316b8e8-61b9-4a12-9afd-4aa7b2961124 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:07.132239 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-2316b8e8-61b9-4a12-9afd-4aa7b2961124 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:07.140638 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-2316b8e8-61b9-4a12-9afd-4aa7b2961124 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea" status: 200 len: 1513 microversion: 2.1 time: 0.173923 Sep 02 05:28:07.141207 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 351/699] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:28:06 2022] GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:28:07.574146 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-5cc71e03-07d9-4b79-ba0b-525503120be9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:07.575097 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-5cc71e03-07d9-4b79-ba0b-525503120be9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:07.581798 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5cc71e03-07d9-4b79-ba0b-525503120be9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:07.582626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5cc71e03-07d9-4b79-ba0b-525503120be9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:07.583116 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5cc71e03-07d9-4b79-ba0b-525503120be9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:07.583904 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5cc71e03-07d9-4b79-ba0b-525503120be9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:07.584697 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5cc71e03-07d9-4b79-ba0b-525503120be9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:07.585094 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5cc71e03-07d9-4b79-ba0b-525503120be9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:07.823903 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-5cc71e03-07d9-4b79-ba0b-525503120be9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:07.839745 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-5cc71e03-07d9-4b79-ba0b-525503120be9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:07.841195 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-5cc71e03-07d9-4b79-ba0b-525503120be9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:07.842886 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-5cc71e03-07d9-4b79-ba0b-525503120be9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1750 microversion: 2.20 time: 0.272346 Sep 02 05:28:07.843479 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 349/700] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:07 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1750 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:08.091805 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-c92bc8d2-567b-4551-bee5-236ef9e18ee4 req-a872da22-390d-4e0d-8da2-23075b3f540b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "985ff518-439b-4f6e-9b9d-d83260bad8ea", "name": "network-vif-deleted", "tag": "c7f90668-6146-4987-9b47-3573fe921638"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:28:08.105578 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-c92bc8d2-567b-4551-bee5-236ef9e18ee4 req-a872da22-390d-4e0d-8da2-23075b3f540b service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:08.106858 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-c92bc8d2-567b-4551-bee5-236ef9e18ee4 req-a872da22-390d-4e0d-8da2-23075b3f540b service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:08.107319 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-c92bc8d2-567b-4551-bee5-236ef9e18ee4 req-a872da22-390d-4e0d-8da2-23075b3f540b service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:08.119985 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-c92bc8d2-567b-4551-bee5-236ef9e18ee4 req-a872da22-390d-4e0d-8da2-23075b3f540b service nova] Creating event network-vif-deleted:c7f90668-6146-4987-9b47-3573fe921638 for instance 985ff518-439b-4f6e-9b9d-d83260bad8ea on hv-cinder-85391 Sep 02 05:28:08.125104 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-c92bc8d2-567b-4551-bee5-236ef9e18ee4 req-a872da22-390d-4e0d-8da2-23075b3f540b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037050 Sep 02 05:28:08.126587 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 352/701] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:28:08.164446 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-1625782d-af81-4c41-873f-8a808fc0a721 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:08.165066 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-1625782d-af81-4c41-873f-8a808fc0a721 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: 985ff518-439b-4f6e-9b9d-d83260bad8ea] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:08.171697 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1625782d-af81-4c41-873f-8a808fc0a721 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:08.172220 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1625782d-af81-4c41-873f-8a808fc0a721 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:08.172652 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1625782d-af81-4c41-873f-8a808fc0a721 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:08.173455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1625782d-af81-4c41-873f-8a808fc0a721 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:08.173937 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1625782d-af81-4c41-873f-8a808fc0a721 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:08.174739 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1625782d-af81-4c41-873f-8a808fc0a721 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:08.243062 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-1625782d-af81-4c41-873f-8a808fc0a721 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:08.253755 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-1625782d-af81-4c41-873f-8a808fc0a721 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea" status: 200 len: 1303 microversion: 2.1 time: 0.093920 Sep 02 05:28:08.254341 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 350/702] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:28:08 2022] GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:28:08.867342 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-d831ecc3-733f-47bc-b017-d11583cdc6c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:08.868032 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-d831ecc3-733f-47bc-b017-d11583cdc6c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:08.874324 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d831ecc3-733f-47bc-b017-d11583cdc6c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:08.875000 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d831ecc3-733f-47bc-b017-d11583cdc6c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:08.875471 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d831ecc3-733f-47bc-b017-d11583cdc6c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:08.876163 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d831ecc3-733f-47bc-b017-d11583cdc6c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:08.876602 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d831ecc3-733f-47bc-b017-d11583cdc6c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:08.877037 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d831ecc3-733f-47bc-b017-d11583cdc6c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:09.276399 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-cce0cc4a-cab7-4454-9555-7b74900e4f5a tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:09.276984 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-cce0cc4a-cab7-4454-9555-7b74900e4f5a tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: 985ff518-439b-4f6e-9b9d-d83260bad8ea] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:09.283466 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cce0cc4a-cab7-4454-9555-7b74900e4f5a tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:09.284044 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cce0cc4a-cab7-4454-9555-7b74900e4f5a tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:09.284711 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cce0cc4a-cab7-4454-9555-7b74900e4f5a tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:09.285485 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cce0cc4a-cab7-4454-9555-7b74900e4f5a tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:09.285878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cce0cc4a-cab7-4454-9555-7b74900e4f5a tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:09.286370 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cce0cc4a-cab7-4454-9555-7b74900e4f5a tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:09.319683 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cce0cc4a-cab7-4454-9555-7b74900e4f5a tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:09.320163 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cce0cc4a-cab7-4454-9555-7b74900e4f5a tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:09.320597 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cce0cc4a-cab7-4454-9555-7b74900e4f5a tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:09.321038 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.objects.instance [None req-cce0cc4a-cab7-4454-9555-7b74900e4f5a tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lazy-loading 'fault' on Instance uuid 985ff518-439b-4f6e-9b9d-d83260bad8ea {{(pid=120448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:28:09.404232 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-d831ecc3-733f-47bc-b017-d11583cdc6c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:09.410365 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-cce0cc4a-cab7-4454-9555-7b74900e4f5a tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5943ce507ca4e67928bc1b98c9e8edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bc748ee5804c9499d0c0b80e14d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:09.418437 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-cce0cc4a-cab7-4454-9555-7b74900e4f5a tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea" status: 200 len: 1308 microversion: 2.1 time: 0.146595 Sep 02 05:28:09.419881 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 351/703] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:28:09 2022] GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea => generated 1308 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:28:09.438263 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-d831ecc3-733f-47bc-b017-d11583cdc6c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:09.439978 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-d831ecc3-733f-47bc-b017-d11583cdc6c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:09.441188 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-d831ecc3-733f-47bc-b017-d11583cdc6c8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.578617 Sep 02 05:28:09.441745 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 353/704] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:08 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:10.454887 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-8fc8dcf4-e0e0-4627-a1c1-a227ecef89e8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:10.456748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-8fc8dcf4-e0e0-4627-a1c1-a227ecef89e8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] [instance: 985ff518-439b-4f6e-9b9d-d83260bad8ea] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:10.464499 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-7dfb7831-9e3a-47b1-aec6-66229acb942e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:10.465134 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-7dfb7831-9e3a-47b1-aec6-66229acb942e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:10.465687 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8fc8dcf4-e0e0-4627-a1c1-a227ecef89e8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:10.466240 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8fc8dcf4-e0e0-4627-a1c1-a227ecef89e8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:10.466749 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8fc8dcf4-e0e0-4627-a1c1-a227ecef89e8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:10.467651 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8fc8dcf4-e0e0-4627-a1c1-a227ecef89e8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:10.468196 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8fc8dcf4-e0e0-4627-a1c1-a227ecef89e8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:10.468815 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8fc8dcf4-e0e0-4627-a1c1-a227ecef89e8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:10.471720 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7dfb7831-9e3a-47b1-aec6-66229acb942e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:10.472252 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7dfb7831-9e3a-47b1-aec6-66229acb942e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:10.472690 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7dfb7831-9e3a-47b1-aec6-66229acb942e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:10.473585 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7dfb7831-9e3a-47b1-aec6-66229acb942e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:10.474055 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7dfb7831-9e3a-47b1-aec6-66229acb942e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:10.474530 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7dfb7831-9e3a-47b1-aec6-66229acb942e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:10.485715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.wsgi [None req-8fc8dcf4-e0e0-4627-a1c1-a227ecef89e8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] HTTP exception thrown: Instance 985ff518-439b-4f6e-9b9d-d83260bad8ea could not be found. Sep 02 05:28:10.491344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-8fc8dcf4-e0e0-4627-a1c1-a227ecef89e8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Request method failure captured: Sep 02 05:28:10.491344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: request: GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea HTTP/1.1 Sep 02 05:28:10.491344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept: application/json Sep 02 05:28:10.491344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept-Encoding: identity Sep 02 05:28:10.491344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Connection: close Sep 02 05:28:10.491344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Length: 0 Sep 02 05:28:10.491344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Type: application/json Sep 02 05:28:10.491344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Host: 10.222.0.30 Sep 02 05:28:10.491344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Openstack-System-Scope: None Sep 02 05:28:10.491344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: User-Agent: python-urllib3/1.26.12 Sep 02 05:28:10.491344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Auth-Token: gAAAAABjEZOtCVhXacz596Ia30eOkgfIIwWVd4kxWqdb_UZVU8ngcQGQr8c7aKyZALfNAO4uMognD1CXQuK7TLSgGmQpxLHlMwsYIITLPEcvX4cHGbLr4b1Xs_HIJ4TvOfC8nmg2qNIhwyABW1AccK5cl4H7NtEDqNKNKeBBslZndFu8IiL4UzQ Sep 02 05:28:10.491344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Id: None Sep 02 05:28:10.491344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Name: None Sep 02 05:28:10.491344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Identity-Status: Confirmed Sep 02 05:28:10.491344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Is-Admin-Project: True Sep 02 05:28:10.491344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Id: default Sep 02 05:28:10.491344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Name: Default Sep 02 05:28:10.491344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Id: a0bc748ee5804c9499d0c0b80e14d711 Sep 02 05:28:10.491344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1789327051 Sep 02 05:28:10.491344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Role: member,reader Sep 02 05:28:10.491344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Roles: member,reader Sep 02 05:28:10.492943 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a0bc748ee5804c9499d0c0b80e14d711"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a0bc748ee5804c9499d0c0b80e14d711"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a0bc748ee5804c9499d0c0b80e14d711"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a0bc748ee5804c9499d0c0b80e14d711"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:28:10.492943 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant: tempest-VolumesSnapshotTestJSON-1789327051 Sep 02 05:28:10.492943 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Id: a0bc748ee5804c9499d0c0b80e14d711 Sep 02 05:28:10.492943 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1789327051 Sep 02 05:28:10.492943 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User: tempest-VolumesSnapshotTestJSON-1789327051-project Sep 02 05:28:10.492943 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Id: default Sep 02 05:28:10.492943 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Name: Default Sep 02 05:28:10.492943 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Id: c5943ce507ca4e67928bc1b98c9e8edb Sep 02 05:28:10.492943 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Name: tempest-VolumesSnapshotTestJSON-1789327051-project Sep 02 05:28:10.492943 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: method: > Sep 02 05:28:10.492943 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: exception: Instance 985ff518-439b-4f6e-9b9d-d83260bad8ea could not be found. Sep 02 05:28:10.492943 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: action_args: {'id': '985ff518-439b-4f6e-9b9d-d83260bad8ea'} Sep 02 05:28:10.493695 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:28:10.493695 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:28:10.493695 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:28:10.493695 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:28:10.493695 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:28:10.493695 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:28:10.493695 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:28:10.493695 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:28:10.493695 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:28:10.493695 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:28:10.493695 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 985ff518-439b-4f6e-9b9d-d83260bad8ea could not be found. Sep 02 05:28:10.493695 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:28:10.493695 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:28:10.493695 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:28:10.493695 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:28:10.493695 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:28:10.493695 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:28:10.493695 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:28:10.493695 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:28:10.493695 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:28:10.494906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:28:10.494906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:28:10.494906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:28:10.494906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:28:10.494906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:28:10.494906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:28:10.494906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:28:10.494906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 985ff518-439b-4f6e-9b9d-d83260bad8ea could not be found. Sep 02 05:28:10.494906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:28:10.494906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:28:10.494906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:28:10.494906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:28:10.494906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:28:10.494906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:28:10.494906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:28:10.494906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:28:10.494906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 985ff518-439b-4f6e-9b9d-d83260bad8ea could not be found. Sep 02 05:28:10.494906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:28:10.496093 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-8fc8dcf4-e0e0-4627-a1c1-a227ecef89e8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] Returning 404 to user: Instance 985ff518-439b-4f6e-9b9d-d83260bad8ea could not be found. {{(pid=120448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:28:10.496093 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-8fc8dcf4-e0e0-4627-a1c1-a227ecef89e8 tempest-VolumesSnapshotTestJSON-1789327051 tempest-VolumesSnapshotTestJSON-1789327051-project] 10.222.0.30 "GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea" status: 404 len: 111 microversion: 2.1 time: 0.043210 Sep 02 05:28:10.496093 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 352/705] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:28:10 2022] GET /compute/v2.1/servers/985ff518-439b-4f6e-9b9d-d83260bad8ea => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:28:10.643598 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-7dfb7831-9e3a-47b1-aec6-66229acb942e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:10.652937 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-7dfb7831-9e3a-47b1-aec6-66229acb942e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:10.654754 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-7dfb7831-9e3a-47b1-aec6-66229acb942e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:10.656266 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-7dfb7831-9e3a-47b1-aec6-66229acb942e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.195853 Sep 02 05:28:10.657030 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 354/706] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:10 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:28:11.682917 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-ab25f4ac-3ab6-40db-96a8-db7eab7d1bc4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:11.684161 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-ab25f4ac-3ab6-40db-96a8-db7eab7d1bc4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:11.691121 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 05:28:11.691448 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Fri Sep 2 05:28:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d (ip 10.222.0.30) !!! Sep 02 05:28:11.695090 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ab25f4ac-3ab6-40db-96a8-db7eab7d1bc4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:11.695750 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ab25f4ac-3ab6-40db-96a8-db7eab7d1bc4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:11.696234 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ab25f4ac-3ab6-40db-96a8-db7eab7d1bc4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:11.697381 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ab25f4ac-3ab6-40db-96a8-db7eab7d1bc4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:11.697955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ab25f4ac-3ab6-40db-96a8-db7eab7d1bc4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:11.701280 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ab25f4ac-3ab6-40db-96a8-db7eab7d1bc4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:11.869585 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-ab25f4ac-3ab6-40db-96a8-db7eab7d1bc4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:11.880389 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-ab25f4ac-3ab6-40db-96a8-db7eab7d1bc4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:11.882206 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-ab25f4ac-3ab6-40db-96a8-db7eab7d1bc4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:11.883794 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-ab25f4ac-3ab6-40db-96a8-db7eab7d1bc4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.206617 Sep 02 05:28:11.884602 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 353/707] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:11 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:12.911107 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-7a02cf3f-8156-4310-9875-51af77c11ab8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:12.912099 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-7a02cf3f-8156-4310-9875-51af77c11ab8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:12.923048 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7a02cf3f-8156-4310-9875-51af77c11ab8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:12.923710 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7a02cf3f-8156-4310-9875-51af77c11ab8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:12.924503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7a02cf3f-8156-4310-9875-51af77c11ab8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:12.925627 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7a02cf3f-8156-4310-9875-51af77c11ab8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:12.926344 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7a02cf3f-8156-4310-9875-51af77c11ab8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:12.927088 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7a02cf3f-8156-4310-9875-51af77c11ab8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:13.111471 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-7a02cf3f-8156-4310-9875-51af77c11ab8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:13.139397 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-7a02cf3f-8156-4310-9875-51af77c11ab8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:13.140886 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-7a02cf3f-8156-4310-9875-51af77c11ab8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:13.145569 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-7a02cf3f-8156-4310-9875-51af77c11ab8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.241012 Sep 02 05:28:13.148493 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 355/708] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:12 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:14.176632 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-3e2c50f4-cebf-43e0-8349-fdbbcdb1c4fa tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:14.177710 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-3e2c50f4-cebf-43e0-8349-fdbbcdb1c4fa tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:14.188890 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3e2c50f4-cebf-43e0-8349-fdbbcdb1c4fa tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:14.189765 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3e2c50f4-cebf-43e0-8349-fdbbcdb1c4fa tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:14.190513 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3e2c50f4-cebf-43e0-8349-fdbbcdb1c4fa tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:14.191835 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3e2c50f4-cebf-43e0-8349-fdbbcdb1c4fa tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:14.192515 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3e2c50f4-cebf-43e0-8349-fdbbcdb1c4fa tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:14.193004 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3e2c50f4-cebf-43e0-8349-fdbbcdb1c4fa tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:14.350980 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-3e2c50f4-cebf-43e0-8349-fdbbcdb1c4fa tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:14.360922 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-3e2c50f4-cebf-43e0-8349-fdbbcdb1c4fa tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:14.362690 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-3e2c50f4-cebf-43e0-8349-fdbbcdb1c4fa tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:14.363979 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-3e2c50f4-cebf-43e0-8349-fdbbcdb1c4fa tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.194514 Sep 02 05:28:14.376193 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 354/709] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:14 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:15.387763 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-820186cf-22dd-4dcc-8b18-04d67026d896 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:15.388457 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-820186cf-22dd-4dcc-8b18-04d67026d896 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:15.395533 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-820186cf-22dd-4dcc-8b18-04d67026d896 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:15.396017 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-820186cf-22dd-4dcc-8b18-04d67026d896 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:15.396474 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-820186cf-22dd-4dcc-8b18-04d67026d896 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:15.397161 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-820186cf-22dd-4dcc-8b18-04d67026d896 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:15.397608 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-820186cf-22dd-4dcc-8b18-04d67026d896 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:15.398028 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-820186cf-22dd-4dcc-8b18-04d67026d896 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:15.535599 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-820186cf-22dd-4dcc-8b18-04d67026d896 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:15.547542 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-820186cf-22dd-4dcc-8b18-04d67026d896 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:15.548747 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-820186cf-22dd-4dcc-8b18-04d67026d896 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:15.549965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-820186cf-22dd-4dcc-8b18-04d67026d896 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.166282 Sep 02 05:28:15.550728 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 356/710] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:15 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:16.578735 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-c4424dac-7f0b-4edc-aa87-d4acd5e44976 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:16.579351 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-c4424dac-7f0b-4edc-aa87-d4acd5e44976 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:16.586047 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c4424dac-7f0b-4edc-aa87-d4acd5e44976 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:16.586525 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c4424dac-7f0b-4edc-aa87-d4acd5e44976 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:16.586963 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c4424dac-7f0b-4edc-aa87-d4acd5e44976 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:16.587639 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c4424dac-7f0b-4edc-aa87-d4acd5e44976 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:16.588108 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c4424dac-7f0b-4edc-aa87-d4acd5e44976 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:16.588565 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c4424dac-7f0b-4edc-aa87-d4acd5e44976 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:16.722996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c4424dac-7f0b-4edc-aa87-d4acd5e44976 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:16.732419 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c4424dac-7f0b-4edc-aa87-d4acd5e44976 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:16.733870 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c4424dac-7f0b-4edc-aa87-d4acd5e44976 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:16.735023 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-c4424dac-7f0b-4edc-aa87-d4acd5e44976 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.160394 Sep 02 05:28:16.735585 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 355/711] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:16 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:17.758551 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-b6354a9d-66a1-42e9-af1f-876ec6e67399 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:17.759169 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-b6354a9d-66a1-42e9-af1f-876ec6e67399 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:17.766118 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b6354a9d-66a1-42e9-af1f-876ec6e67399 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:17.766600 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b6354a9d-66a1-42e9-af1f-876ec6e67399 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:17.767032 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b6354a9d-66a1-42e9-af1f-876ec6e67399 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:17.767717 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b6354a9d-66a1-42e9-af1f-876ec6e67399 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:17.768235 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b6354a9d-66a1-42e9-af1f-876ec6e67399 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:17.768658 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b6354a9d-66a1-42e9-af1f-876ec6e67399 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:17.920178 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-b6354a9d-66a1-42e9-af1f-876ec6e67399 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:17.930950 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-b6354a9d-66a1-42e9-af1f-876ec6e67399 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:17.933381 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-b6354a9d-66a1-42e9-af1f-876ec6e67399 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:17.935018 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-b6354a9d-66a1-42e9-af1f-876ec6e67399 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.180385 Sep 02 05:28:17.947431 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 357/712] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:17 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:18.966947 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-492a298a-5e14-48a9-b3c6-3ae368383c27 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:18.967997 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-492a298a-5e14-48a9-b3c6-3ae368383c27 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:18.980505 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-492a298a-5e14-48a9-b3c6-3ae368383c27 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:18.981822 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-492a298a-5e14-48a9-b3c6-3ae368383c27 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:18.982527 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-492a298a-5e14-48a9-b3c6-3ae368383c27 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:18.983687 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-492a298a-5e14-48a9-b3c6-3ae368383c27 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:18.984487 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-492a298a-5e14-48a9-b3c6-3ae368383c27 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:18.985245 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-492a298a-5e14-48a9-b3c6-3ae368383c27 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:19.154333 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-492a298a-5e14-48a9-b3c6-3ae368383c27 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:19.161062 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-492a298a-5e14-48a9-b3c6-3ae368383c27 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:19.163248 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-492a298a-5e14-48a9-b3c6-3ae368383c27 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:19.164527 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-492a298a-5e14-48a9-b3c6-3ae368383c27 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.206041 Sep 02 05:28:19.165368 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 356/713] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:18 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:28:20.306917 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-6b2c91da-eb96-4138-a73c-d567d128261f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:20.306917 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-6b2c91da-eb96-4138-a73c-d567d128261f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:20.313363 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6b2c91da-eb96-4138-a73c-d567d128261f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:20.313846 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6b2c91da-eb96-4138-a73c-d567d128261f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:20.314278 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6b2c91da-eb96-4138-a73c-d567d128261f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:20.314972 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6b2c91da-eb96-4138-a73c-d567d128261f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:20.315420 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6b2c91da-eb96-4138-a73c-d567d128261f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:20.315828 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6b2c91da-eb96-4138-a73c-d567d128261f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:20.467946 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-6b2c91da-eb96-4138-a73c-d567d128261f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:20.477381 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-6b2c91da-eb96-4138-a73c-d567d128261f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:20.478806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-6b2c91da-eb96-4138-a73c-d567d128261f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:20.479976 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-6b2c91da-eb96-4138-a73c-d567d128261f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.297006 Sep 02 05:28:20.480565 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 358/714] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:20 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:21.502902 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-814a5139-1a64-4ba4-a6ba-14660f10670f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:21.503464 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-814a5139-1a64-4ba4-a6ba-14660f10670f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:21.510313 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-814a5139-1a64-4ba4-a6ba-14660f10670f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:21.510794 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-814a5139-1a64-4ba4-a6ba-14660f10670f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:21.511219 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-814a5139-1a64-4ba4-a6ba-14660f10670f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:21.511962 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-814a5139-1a64-4ba4-a6ba-14660f10670f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:21.512462 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-814a5139-1a64-4ba4-a6ba-14660f10670f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:21.512882 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-814a5139-1a64-4ba4-a6ba-14660f10670f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:21.517288 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:21.648789 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-814a5139-1a64-4ba4-a6ba-14660f10670f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:21.657653 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-814a5139-1a64-4ba4-a6ba-14660f10670f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:21.659070 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-814a5139-1a64-4ba4-a6ba-14660f10670f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:21.660265 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-814a5139-1a64-4ba4-a6ba-14660f10670f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.161299 Sep 02 05:28:21.660828 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 357/715] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:21 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:22.687845 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-09bb4929-bf12-494a-9b9f-6f084f996708 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:22.688828 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-09bb4929-bf12-494a-9b9f-6f084f996708 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:22.699630 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-09bb4929-bf12-494a-9b9f-6f084f996708 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:22.700501 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-09bb4929-bf12-494a-9b9f-6f084f996708 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:22.701204 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-09bb4929-bf12-494a-9b9f-6f084f996708 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:22.702990 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-09bb4929-bf12-494a-9b9f-6f084f996708 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:22.702990 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-09bb4929-bf12-494a-9b9f-6f084f996708 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:22.703972 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-09bb4929-bf12-494a-9b9f-6f084f996708 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:22.836219 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-09bb4929-bf12-494a-9b9f-6f084f996708 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:22.839774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:22.849828 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-09bb4929-bf12-494a-9b9f-6f084f996708 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:22.851242 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-09bb4929-bf12-494a-9b9f-6f084f996708 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:22.852460 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-09bb4929-bf12-494a-9b9f-6f084f996708 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.171060 Sep 02 05:28:22.853003 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 359/716] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:22 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:23.880056 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-425e7d44-42b1-44e5-b699-3445a5e56455 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:23.881371 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-425e7d44-42b1-44e5-b699-3445a5e56455 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:23.895064 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-425e7d44-42b1-44e5-b699-3445a5e56455 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:23.895972 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-425e7d44-42b1-44e5-b699-3445a5e56455 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:23.896735 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-425e7d44-42b1-44e5-b699-3445a5e56455 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:23.897906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-425e7d44-42b1-44e5-b699-3445a5e56455 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:23.898659 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-425e7d44-42b1-44e5-b699-3445a5e56455 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:23.899394 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-425e7d44-42b1-44e5-b699-3445a5e56455 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:24.039089 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-425e7d44-42b1-44e5-b699-3445a5e56455 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:24.048079 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-425e7d44-42b1-44e5-b699-3445a5e56455 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:24.049538 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-425e7d44-42b1-44e5-b699-3445a5e56455 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:24.050673 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-425e7d44-42b1-44e5-b699-3445a5e56455 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.177832 Sep 02 05:28:24.051259 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 358/717] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:23 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:25.077925 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-2b54f121-4c9e-4be5-8245-5dfc1bb6edfc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:25.078871 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-2b54f121-4c9e-4be5-8245-5dfc1bb6edfc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:25.083013 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_api:SELECT=36 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:25.093767 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2b54f121-4c9e-4be5-8245-5dfc1bb6edfc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:25.094493 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2b54f121-4c9e-4be5-8245-5dfc1bb6edfc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:25.094912 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2b54f121-4c9e-4be5-8245-5dfc1bb6edfc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:25.095599 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2b54f121-4c9e-4be5-8245-5dfc1bb6edfc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:25.096049 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2b54f121-4c9e-4be5-8245-5dfc1bb6edfc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:25.096496 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2b54f121-4c9e-4be5-8245-5dfc1bb6edfc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:25.227487 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-2b54f121-4c9e-4be5-8245-5dfc1bb6edfc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:25.236224 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-2b54f121-4c9e-4be5-8245-5dfc1bb6edfc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:25.237639 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-2b54f121-4c9e-4be5-8245-5dfc1bb6edfc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:25.238788 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-2b54f121-4c9e-4be5-8245-5dfc1bb6edfc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.167621 Sep 02 05:28:25.239315 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 360/718] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:25 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:26.266657 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-03b57a4b-725b-4c09-9609-ac421112a47a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:26.267339 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-03b57a4b-725b-4c09-9609-ac421112a47a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:26.275136 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-03b57a4b-725b-4c09-9609-ac421112a47a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:26.275699 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-03b57a4b-725b-4c09-9609-ac421112a47a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:26.276236 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-03b57a4b-725b-4c09-9609-ac421112a47a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:26.277030 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-03b57a4b-725b-4c09-9609-ac421112a47a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:26.277553 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-03b57a4b-725b-4c09-9609-ac421112a47a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:26.278046 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-03b57a4b-725b-4c09-9609-ac421112a47a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:26.410807 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-03b57a4b-725b-4c09-9609-ac421112a47a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:26.419296 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-03b57a4b-725b-4c09-9609-ac421112a47a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:26.420736 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-03b57a4b-725b-4c09-9609-ac421112a47a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:26.421882 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-03b57a4b-725b-4c09-9609-ac421112a47a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.161893 Sep 02 05:28:26.422433 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 359/719] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:26 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:27.446052 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-195e1582-b34d-4eb7-9ef8-91adc4011ca3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:27.446670 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-195e1582-b34d-4eb7-9ef8-91adc4011ca3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:27.454182 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-195e1582-b34d-4eb7-9ef8-91adc4011ca3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:27.454717 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-195e1582-b34d-4eb7-9ef8-91adc4011ca3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:27.455202 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-195e1582-b34d-4eb7-9ef8-91adc4011ca3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:27.455959 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-195e1582-b34d-4eb7-9ef8-91adc4011ca3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:27.456521 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-195e1582-b34d-4eb7-9ef8-91adc4011ca3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:27.456990 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-195e1582-b34d-4eb7-9ef8-91adc4011ca3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:27.593872 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-195e1582-b34d-4eb7-9ef8-91adc4011ca3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:27.602576 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-195e1582-b34d-4eb7-9ef8-91adc4011ca3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:27.604092 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-195e1582-b34d-4eb7-9ef8-91adc4011ca3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:27.605259 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-195e1582-b34d-4eb7-9ef8-91adc4011ca3 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.163662 Sep 02 05:28:27.606160 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 361/720] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:27 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:28.633385 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-e4c793fc-6a02-46c3-a465-7c71edcba598 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:28.634374 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-e4c793fc-6a02-46c3-a465-7c71edcba598 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:28.643894 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e4c793fc-6a02-46c3-a465-7c71edcba598 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:28.644317 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e4c793fc-6a02-46c3-a465-7c71edcba598 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:28.644753 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e4c793fc-6a02-46c3-a465-7c71edcba598 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:28.645442 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e4c793fc-6a02-46c3-a465-7c71edcba598 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:28.645892 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e4c793fc-6a02-46c3-a465-7c71edcba598 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:28.646314 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e4c793fc-6a02-46c3-a465-7c71edcba598 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:28.778563 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-e4c793fc-6a02-46c3-a465-7c71edcba598 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:28.791819 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-e4c793fc-6a02-46c3-a465-7c71edcba598 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:28.793522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-e4c793fc-6a02-46c3-a465-7c71edcba598 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:28.795507 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-e4c793fc-6a02-46c3-a465-7c71edcba598 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.168677 Sep 02 05:28:28.796295 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 360/721] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:28 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:29.820961 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-6725030d-8f5a-4509-bc5f-8f7d181f2c26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:29.821584 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-6725030d-8f5a-4509-bc5f-8f7d181f2c26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:29.830344 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6725030d-8f5a-4509-bc5f-8f7d181f2c26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:29.831020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6725030d-8f5a-4509-bc5f-8f7d181f2c26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:29.831678 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6725030d-8f5a-4509-bc5f-8f7d181f2c26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:29.832786 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6725030d-8f5a-4509-bc5f-8f7d181f2c26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:29.833448 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6725030d-8f5a-4509-bc5f-8f7d181f2c26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:29.834065 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6725030d-8f5a-4509-bc5f-8f7d181f2c26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:30.007594 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-6725030d-8f5a-4509-bc5f-8f7d181f2c26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:30.017944 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-6725030d-8f5a-4509-bc5f-8f7d181f2c26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:30.019370 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-6725030d-8f5a-4509-bc5f-8f7d181f2c26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:30.020554 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-6725030d-8f5a-4509-bc5f-8f7d181f2c26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.204806 Sep 02 05:28:30.021109 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 362/722] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:29 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:31.045561 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-cc59117c-d831-4539-bed3-04376fe3030b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:31.046212 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-cc59117c-d831-4539-bed3-04376fe3030b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:31.048926 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=2 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:31.054516 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cc59117c-d831-4539-bed3-04376fe3030b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:31.054994 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cc59117c-d831-4539-bed3-04376fe3030b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:31.055423 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cc59117c-d831-4539-bed3-04376fe3030b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:31.056099 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cc59117c-d831-4539-bed3-04376fe3030b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:31.056569 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cc59117c-d831-4539-bed3-04376fe3030b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:31.056983 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cc59117c-d831-4539-bed3-04376fe3030b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:31.200553 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-cc59117c-d831-4539-bed3-04376fe3030b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:31.209659 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-cc59117c-d831-4539-bed3-04376fe3030b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:31.211313 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-cc59117c-d831-4539-bed3-04376fe3030b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:31.212594 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-cc59117c-d831-4539-bed3-04376fe3030b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.173054 Sep 02 05:28:31.213224 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 361/723] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:31 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:32.236342 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-1db471d9-27d7-441f-a758-24ddd80a02af tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:32.236941 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-1db471d9-27d7-441f-a758-24ddd80a02af tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:32.243681 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1db471d9-27d7-441f-a758-24ddd80a02af tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:32.244150 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1db471d9-27d7-441f-a758-24ddd80a02af tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:32.244619 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1db471d9-27d7-441f-a758-24ddd80a02af tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:32.245299 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1db471d9-27d7-441f-a758-24ddd80a02af tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:32.245751 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1db471d9-27d7-441f-a758-24ddd80a02af tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:32.246171 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1db471d9-27d7-441f-a758-24ddd80a02af tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:32.392067 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1db471d9-27d7-441f-a758-24ddd80a02af tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:32.400997 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1db471d9-27d7-441f-a758-24ddd80a02af tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:32.402424 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1db471d9-27d7-441f-a758-24ddd80a02af tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:32.403588 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-1db471d9-27d7-441f-a758-24ddd80a02af tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.171562 Sep 02 05:28:32.404151 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 363/724] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:32 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:33.430973 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d33ec4b3-b961-48aa-8bdd-46c9770b5a34 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:33.431997 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-d33ec4b3-b961-48aa-8bdd-46c9770b5a34 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:33.441276 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d33ec4b3-b961-48aa-8bdd-46c9770b5a34 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:33.441772 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d33ec4b3-b961-48aa-8bdd-46c9770b5a34 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:33.442209 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d33ec4b3-b961-48aa-8bdd-46c9770b5a34 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:33.442935 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d33ec4b3-b961-48aa-8bdd-46c9770b5a34 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:33.443395 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d33ec4b3-b961-48aa-8bdd-46c9770b5a34 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:33.443823 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d33ec4b3-b961-48aa-8bdd-46c9770b5a34 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:33.598446 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d33ec4b3-b961-48aa-8bdd-46c9770b5a34 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:33.611953 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d33ec4b3-b961-48aa-8bdd-46c9770b5a34 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:33.614046 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d33ec4b3-b961-48aa-8bdd-46c9770b5a34 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:33.616111 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-d33ec4b3-b961-48aa-8bdd-46c9770b5a34 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.191488 Sep 02 05:28:33.617431 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 362/725] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:33 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:34.645413 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-badea527-852c-42e8-9f59-8a3e2763734d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:34.646309 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-badea527-852c-42e8-9f59-8a3e2763734d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:34.654505 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-badea527-852c-42e8-9f59-8a3e2763734d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:34.655143 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-badea527-852c-42e8-9f59-8a3e2763734d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:34.655740 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-badea527-852c-42e8-9f59-8a3e2763734d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:34.656846 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-badea527-852c-42e8-9f59-8a3e2763734d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:34.657506 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-badea527-852c-42e8-9f59-8a3e2763734d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:34.658106 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-badea527-852c-42e8-9f59-8a3e2763734d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:34.801217 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-badea527-852c-42e8-9f59-8a3e2763734d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:34.813759 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-badea527-852c-42e8-9f59-8a3e2763734d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:34.815200 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-badea527-852c-42e8-9f59-8a3e2763734d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:34.816393 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-badea527-852c-42e8-9f59-8a3e2763734d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.175673 Sep 02 05:28:34.816925 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 364/726] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:34 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:35.843859 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-c217bbc4-5861-4155-8b8e-8fcdd1d15794 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:35.844837 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-c217bbc4-5861-4155-8b8e-8fcdd1d15794 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:35.852905 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c217bbc4-5861-4155-8b8e-8fcdd1d15794 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:35.853479 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c217bbc4-5861-4155-8b8e-8fcdd1d15794 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:35.853994 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c217bbc4-5861-4155-8b8e-8fcdd1d15794 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:35.854804 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c217bbc4-5861-4155-8b8e-8fcdd1d15794 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:35.855350 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c217bbc4-5861-4155-8b8e-8fcdd1d15794 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:35.855847 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c217bbc4-5861-4155-8b8e-8fcdd1d15794 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:35.988007 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c217bbc4-5861-4155-8b8e-8fcdd1d15794 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:35.998153 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c217bbc4-5861-4155-8b8e-8fcdd1d15794 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:35.999620 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c217bbc4-5861-4155-8b8e-8fcdd1d15794 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:36.000804 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-c217bbc4-5861-4155-8b8e-8fcdd1d15794 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.163448 Sep 02 05:28:36.001405 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 363/727] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:35 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:37.031132 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-b9d6d6cd-d06d-4946-8d85-2fcb07b5ed05 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:37.031991 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-b9d6d6cd-d06d-4946-8d85-2fcb07b5ed05 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:37.042785 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b9d6d6cd-d06d-4946-8d85-2fcb07b5ed05 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:37.043575 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b9d6d6cd-d06d-4946-8d85-2fcb07b5ed05 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:37.044330 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b9d6d6cd-d06d-4946-8d85-2fcb07b5ed05 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:37.045444 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b9d6d6cd-d06d-4946-8d85-2fcb07b5ed05 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:37.046186 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b9d6d6cd-d06d-4946-8d85-2fcb07b5ed05 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:37.046883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b9d6d6cd-d06d-4946-8d85-2fcb07b5ed05 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:37.186304 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-b9d6d6cd-d06d-4946-8d85-2fcb07b5ed05 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:37.195120 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-b9d6d6cd-d06d-4946-8d85-2fcb07b5ed05 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:37.196600 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-b9d6d6cd-d06d-4946-8d85-2fcb07b5ed05 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:37.197766 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-b9d6d6cd-d06d-4946-8d85-2fcb07b5ed05 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.173344 Sep 02 05:28:37.198321 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 365/728] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:37 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:38.220823 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-bfa52c16-3d16-4f4d-9631-873cff96dd19 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:38.221346 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-bfa52c16-3d16-4f4d-9631-873cff96dd19 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:38.227885 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-bfa52c16-3d16-4f4d-9631-873cff96dd19 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:38.228398 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-bfa52c16-3d16-4f4d-9631-873cff96dd19 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:38.228822 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-bfa52c16-3d16-4f4d-9631-873cff96dd19 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:38.229512 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-bfa52c16-3d16-4f4d-9631-873cff96dd19 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:38.229953 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-bfa52c16-3d16-4f4d-9631-873cff96dd19 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:38.230370 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-bfa52c16-3d16-4f4d-9631-873cff96dd19 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:38.359324 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-bfa52c16-3d16-4f4d-9631-873cff96dd19 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:38.368274 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-bfa52c16-3d16-4f4d-9631-873cff96dd19 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:38.369703 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-bfa52c16-3d16-4f4d-9631-873cff96dd19 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:38.370899 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-bfa52c16-3d16-4f4d-9631-873cff96dd19 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.154047 Sep 02 05:28:38.371436 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 364/729] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:38 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:39.401647 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-bbc75502-9c00-4a9b-b151-89760f0dcd0f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:39.402390 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-bbc75502-9c00-4a9b-b151-89760f0dcd0f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:39.409689 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bbc75502-9c00-4a9b-b151-89760f0dcd0f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:39.410317 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bbc75502-9c00-4a9b-b151-89760f0dcd0f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:39.410836 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bbc75502-9c00-4a9b-b151-89760f0dcd0f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:39.411611 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bbc75502-9c00-4a9b-b151-89760f0dcd0f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:39.412142 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bbc75502-9c00-4a9b-b151-89760f0dcd0f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:39.412659 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bbc75502-9c00-4a9b-b151-89760f0dcd0f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:39.545905 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-bbc75502-9c00-4a9b-b151-89760f0dcd0f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:39.555198 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-bbc75502-9c00-4a9b-b151-89760f0dcd0f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:39.556833 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-bbc75502-9c00-4a9b-b151-89760f0dcd0f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:39.557996 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-bbc75502-9c00-4a9b-b151-89760f0dcd0f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.160183 Sep 02 05:28:39.558777 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 366/730] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:39 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:40.581438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d04198a0-768b-468a-ad8c-0b59f215983a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:40.582103 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-d04198a0-768b-468a-ad8c-0b59f215983a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:40.589476 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d04198a0-768b-468a-ad8c-0b59f215983a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:40.590111 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d04198a0-768b-468a-ad8c-0b59f215983a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:40.590550 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d04198a0-768b-468a-ad8c-0b59f215983a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:40.591314 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d04198a0-768b-468a-ad8c-0b59f215983a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:40.591729 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d04198a0-768b-468a-ad8c-0b59f215983a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:40.597538 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d04198a0-768b-468a-ad8c-0b59f215983a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:40.729249 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d04198a0-768b-468a-ad8c-0b59f215983a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:40.738185 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d04198a0-768b-468a-ad8c-0b59f215983a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:40.739606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d04198a0-768b-468a-ad8c-0b59f215983a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:40.741103 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-d04198a0-768b-468a-ad8c-0b59f215983a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.163722 Sep 02 05:28:40.741659 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 365/731] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:40 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:28:41.763263 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ed087f9a-c3d2-4d25-8ba5-9b0a702506d7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:41.763838 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-ed087f9a-c3d2-4d25-8ba5-9b0a702506d7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:41.770691 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ed087f9a-c3d2-4d25-8ba5-9b0a702506d7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:41.771169 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ed087f9a-c3d2-4d25-8ba5-9b0a702506d7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:41.771597 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ed087f9a-c3d2-4d25-8ba5-9b0a702506d7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:41.772314 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ed087f9a-c3d2-4d25-8ba5-9b0a702506d7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:41.772760 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ed087f9a-c3d2-4d25-8ba5-9b0a702506d7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:41.773463 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ed087f9a-c3d2-4d25-8ba5-9b0a702506d7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:41.903908 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ed087f9a-c3d2-4d25-8ba5-9b0a702506d7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:41.913702 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ed087f9a-c3d2-4d25-8ba5-9b0a702506d7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:41.915116 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ed087f9a-c3d2-4d25-8ba5-9b0a702506d7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:41.916507 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-ed087f9a-c3d2-4d25-8ba5-9b0a702506d7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.157137 Sep 02 05:28:41.917585 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 367/732] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:41 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:42.940402 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-8f3fd631-363a-478d-b691-91ae1386cec5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:42.941021 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-8f3fd631-363a-478d-b691-91ae1386cec5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:42.947464 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8f3fd631-363a-478d-b691-91ae1386cec5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:42.947990 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8f3fd631-363a-478d-b691-91ae1386cec5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:42.948449 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8f3fd631-363a-478d-b691-91ae1386cec5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:42.949134 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8f3fd631-363a-478d-b691-91ae1386cec5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:42.949582 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8f3fd631-363a-478d-b691-91ae1386cec5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:42.950026 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8f3fd631-363a-478d-b691-91ae1386cec5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:43.086477 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-8f3fd631-363a-478d-b691-91ae1386cec5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:43.097549 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-8f3fd631-363a-478d-b691-91ae1386cec5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:43.099766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-8f3fd631-363a-478d-b691-91ae1386cec5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:43.101245 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-8f3fd631-363a-478d-b691-91ae1386cec5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.164864 Sep 02 05:28:43.112502 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 366/733] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:42 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:44.132207 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5109e3bc-ad19-4fd1-aa5f-8ca82d1ccd97 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:44.133198 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5109e3bc-ad19-4fd1-aa5f-8ca82d1ccd97 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:44.144004 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5109e3bc-ad19-4fd1-aa5f-8ca82d1ccd97 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:44.144842 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5109e3bc-ad19-4fd1-aa5f-8ca82d1ccd97 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:44.145548 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5109e3bc-ad19-4fd1-aa5f-8ca82d1ccd97 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:44.146676 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5109e3bc-ad19-4fd1-aa5f-8ca82d1ccd97 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:44.147418 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5109e3bc-ad19-4fd1-aa5f-8ca82d1ccd97 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:44.148169 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5109e3bc-ad19-4fd1-aa5f-8ca82d1ccd97 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:44.285072 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5109e3bc-ad19-4fd1-aa5f-8ca82d1ccd97 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:44.294347 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5109e3bc-ad19-4fd1-aa5f-8ca82d1ccd97 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:44.295981 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5109e3bc-ad19-4fd1-aa5f-8ca82d1ccd97 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:44.297534 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5109e3bc-ad19-4fd1-aa5f-8ca82d1ccd97 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.171632 Sep 02 05:28:44.298295 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 368/734] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:44 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:44.665443 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-41ffca7a-8ae6-4023-b49b-3f3c093f52e0 req-8920918a-4fd7-424e-aa89-bcbc0f2b8d57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e32b402-d6f2-4861-a864-005e1a9f808d", "name": "network-vif-plugged", "status": "completed", "tag": "26f374c2-ecf9-4064-b5ad-13f47d97521e"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:28:44.677569 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-41ffca7a-8ae6-4023-b49b-3f3c093f52e0 req-8920918a-4fd7-424e-aa89-bcbc0f2b8d57 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:44.678046 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-41ffca7a-8ae6-4023-b49b-3f3c093f52e0 req-8920918a-4fd7-424e-aa89-bcbc0f2b8d57 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:44.678475 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-41ffca7a-8ae6-4023-b49b-3f3c093f52e0 req-8920918a-4fd7-424e-aa89-bcbc0f2b8d57 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:44.690172 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-41ffca7a-8ae6-4023-b49b-3f3c093f52e0 req-8920918a-4fd7-424e-aa89-bcbc0f2b8d57 service nova] Creating event network-vif-plugged:26f374c2-ecf9-4064-b5ad-13f47d97521e for instance 1e32b402-d6f2-4861-a864-005e1a9f808d on hv-cinder-85391 Sep 02 05:28:44.695782 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-41ffca7a-8ae6-4023-b49b-3f3c093f52e0 req-8920918a-4fd7-424e-aa89-bcbc0f2b8d57 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035317 Sep 02 05:28:44.696368 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 367/735] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:28:45.321485 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-24dec407-2954-4cb7-8490-1357d18ef5bb tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:45.322052 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-24dec407-2954-4cb7-8490-1357d18ef5bb tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:45.328667 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-24dec407-2954-4cb7-8490-1357d18ef5bb tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:45.329170 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-24dec407-2954-4cb7-8490-1357d18ef5bb tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:45.329611 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-24dec407-2954-4cb7-8490-1357d18ef5bb tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:45.330291 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-24dec407-2954-4cb7-8490-1357d18ef5bb tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:45.330738 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-24dec407-2954-4cb7-8490-1357d18ef5bb tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:45.331155 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-24dec407-2954-4cb7-8490-1357d18ef5bb tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:45.538257 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-24dec407-2954-4cb7-8490-1357d18ef5bb tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:45.547709 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-24dec407-2954-4cb7-8490-1357d18ef5bb tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:45.549395 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-24dec407-2954-4cb7-8490-1357d18ef5bb tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:45.550594 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-24dec407-2954-4cb7-8490-1357d18ef5bb tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.233371 Sep 02 05:28:45.551167 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 369/736] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:45 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:46.575349 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-de5721d0-81af-4ac6-b2e5-6762c66a23e1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:46.576145 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-de5721d0-81af-4ac6-b2e5-6762c66a23e1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:46.582695 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-de5721d0-81af-4ac6-b2e5-6762c66a23e1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:46.583212 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-de5721d0-81af-4ac6-b2e5-6762c66a23e1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:46.583690 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-de5721d0-81af-4ac6-b2e5-6762c66a23e1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:46.584439 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-de5721d0-81af-4ac6-b2e5-6762c66a23e1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:46.584877 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-de5721d0-81af-4ac6-b2e5-6762c66a23e1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:46.585342 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-de5721d0-81af-4ac6-b2e5-6762c66a23e1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:46.729576 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-de5721d0-81af-4ac6-b2e5-6762c66a23e1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:46.739557 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-de5721d0-81af-4ac6-b2e5-6762c66a23e1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:46.741364 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-de5721d0-81af-4ac6-b2e5-6762c66a23e1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:46.742534 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-de5721d0-81af-4ac6-b2e5-6762c66a23e1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.172314 Sep 02 05:28:46.743087 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 368/737] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:46 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:47.765631 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-b217fde1-0dc3-4c4e-bf70-de01b14d7377 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:47.767073 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-b217fde1-0dc3-4c4e-bf70-de01b14d7377 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:47.777989 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b217fde1-0dc3-4c4e-bf70-de01b14d7377 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:47.778712 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b217fde1-0dc3-4c4e-bf70-de01b14d7377 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:47.779312 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b217fde1-0dc3-4c4e-bf70-de01b14d7377 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:47.781827 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b217fde1-0dc3-4c4e-bf70-de01b14d7377 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:47.782475 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b217fde1-0dc3-4c4e-bf70-de01b14d7377 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:47.783072 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b217fde1-0dc3-4c4e-bf70-de01b14d7377 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:47.963834 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-b217fde1-0dc3-4c4e-bf70-de01b14d7377 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:47.974387 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-b217fde1-0dc3-4c4e-bf70-de01b14d7377 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:47.978415 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-b217fde1-0dc3-4c4e-bf70-de01b14d7377 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:47.979687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-b217fde1-0dc3-4c4e-bf70-de01b14d7377 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1806 microversion: 2.20 time: 0.217904 Sep 02 05:28:47.980799 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 370/738] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:47 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1806 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:49.007595 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-21890871-e3f9-4d34-9dc1-7e507240a136 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:28:49.010047 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-21890871-e3f9-4d34-9dc1-7e507240a136 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:28:49.017107 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-21890871-e3f9-4d34-9dc1-7e507240a136 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:49.017637 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-21890871-e3f9-4d34-9dc1-7e507240a136 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:49.018308 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-21890871-e3f9-4d34-9dc1-7e507240a136 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:49.019260 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-21890871-e3f9-4d34-9dc1-7e507240a136 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:28:49.019964 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-21890871-e3f9-4d34-9dc1-7e507240a136 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:28:49.020579 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-21890871-e3f9-4d34-9dc1-7e507240a136 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:28:49.345503 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-21890871-e3f9-4d34-9dc1-7e507240a136 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:49.361142 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-21890871-e3f9-4d34-9dc1-7e507240a136 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:49.362472 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-21890871-e3f9-4d34-9dc1-7e507240a136 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:28:49.368449 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-21890871-e3f9-4d34-9dc1-7e507240a136 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1793 microversion: 2.20 time: 0.365149 Sep 02 05:28:49.369042 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 369/739] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:28:49 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1793 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:28:56.341633 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-1440ac0e-d678-4967-8f74-46b54267e39b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Action: 'create', calling method: .version_select at 0x7fc90b312940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1280367057", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByhNzwBT/PuBrAShEtg4AU2rpi4Ccsetx4kJCg0Rv+R5KpOU6EKHuk5G9QPbxesapRAyT2+WnP9AMSXi8wDdzhyfLcwUW9XwOSlCVtwBisBxwPlU+L4KDJdE0sEQJmEsg=="}} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:28:56.348527 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_api:SELECT=22 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:56.359025 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.quota [None req-1440ac0e-d678-4967-8f74-46b54267e39b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Getting quotas for project e45a42292fe94dccaa14ba6bc41ded09. Resources: {'key_pairs'} {{(pid=120449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:28:56.363368 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.quota [None req-1440ac0e-d678-4967-8f74-46b54267e39b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Getting quotas for user 03812cff7628436f952ea5be41420297 and project e45a42292fe94dccaa14ba6bc41ded09. Resources: {'key_pairs'} {{(pid=120449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:28:56.389495 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-1440ac0e-d678-4967-8f74-46b54267e39b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.284962 Sep 02 05:28:56.390365 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 371/740] 10.222.0.30 () {60 vars in 1159 bytes} [Fri Sep 2 05:28:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:29:21.954970 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-64abe4e1-89f0-47bf-9599-87e92be39bb5 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:21.955825 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-64abe4e1-89f0-47bf-9599-87e92be39bb5 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:21.958818 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=17 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:21.959459 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=73 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:21.965478 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-64abe4e1-89f0-47bf-9599-87e92be39bb5 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:21.965958 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-64abe4e1-89f0-47bf-9599-87e92be39bb5 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:21.966395 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-64abe4e1-89f0-47bf-9599-87e92be39bb5 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:21.967084 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-64abe4e1-89f0-47bf-9599-87e92be39bb5 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:21.967511 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-64abe4e1-89f0-47bf-9599-87e92be39bb5 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:21.967963 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-64abe4e1-89f0-47bf-9599-87e92be39bb5 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:21.991778 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-64abe4e1-89f0-47bf-9599-87e92be39bb5 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27/ips" status: 200 len: 145 microversion: 2.1 time: 0.043414 Sep 02 05:29:21.992407 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 370/741] 10.222.0.30 () {58 vars in 1248 bytes} [Fri Sep 2 05:29:21 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27/ips => generated 145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:29:24.076064 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=67 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:24.077007 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell0:SELECT=4 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:24.077611 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:24.081847 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-69779c29-8bfc-4175-8d3c-76840dee33ad tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a506e234-2189-496e-8270-511dbbb1908f"}} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:29:24.084467 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-69779c29-8bfc-4175-8d3c-76840dee33ad tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:24.092774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-69779c29-8bfc-4175-8d3c-76840dee33ad tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:24.093259 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-69779c29-8bfc-4175-8d3c-76840dee33ad tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:24.093696 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-69779c29-8bfc-4175-8d3c-76840dee33ad tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:24.094392 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-69779c29-8bfc-4175-8d3c-76840dee33ad tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:24.094844 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-69779c29-8bfc-4175-8d3c-76840dee33ad tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:24.095269 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-69779c29-8bfc-4175-8d3c-76840dee33ad tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:24.384010 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-321e1608-8bcd-4260-8bc7-f7e648bd9872 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2042255043", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1280367057", "security_groups": [{"name": "tempest-secgroup-smoke-609092212"}], "block_device_mapping_v2": [{"uuid": "cd6b57c5-6b02-48fc-b0a1-fb8bc2e67d9b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8d5e3ffd-1ee0-4cbd-8c2c-83ff33c46dbd"}]}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:29:24.476167 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-69779c29-8bfc-4175-8d3c-76840dee33ad tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "POST /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.400995 Sep 02 05:29:24.476830 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 372/742] 10.222.0.30 () {60 vars in 1323 bytes} [Fri Sep 2 05:29:24 2022] POST /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27/os-volume_attachments => generated 194 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:29:24.506384 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.network.neutron [None req-321e1608-8bcd-4260-8bc7-f7e648bd9872 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] validate_networks() for [('8d5e3ffd-1ee0-4cbd-8c2c-83ff33c46dbd', None, None, None, None, None)] {{(pid=120448) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 05:29:24.987014 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-321e1608-8bcd-4260-8bc7-f7e648bd9872 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Flavor limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 05:29:24.987664 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-321e1608-8bcd-4260-8bc7-f7e648bd9872 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Image limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 05:29:24.988456 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-321e1608-8bcd-4260-8bc7-f7e648bd9872 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Flavor pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 05:29:24.989006 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-321e1608-8bcd-4260-8bc7-f7e648bd9872 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Image pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 05:29:24.990011 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-321e1608-8bcd-4260-8bc7-f7e648bd9872 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 05:29:24.999273 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-321e1608-8bcd-4260-8bc7-f7e648bd9872 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:24.999749 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-321e1608-8bcd-4260-8bc7-f7e648bd9872 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:25.000202 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-321e1608-8bcd-4260-8bc7-f7e648bd9872 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:25.000929 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-321e1608-8bcd-4260-8bc7-f7e648bd9872 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:25.001378 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-321e1608-8bcd-4260-8bc7-f7e648bd9872 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:25.001790 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-321e1608-8bcd-4260-8bc7-f7e648bd9872 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:25.018537 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-321e1608-8bcd-4260-8bc7-f7e648bd9872 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Getting quotas for project e45a42292fe94dccaa14ba6bc41ded09. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:29:25.022954 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-321e1608-8bcd-4260-8bc7-f7e648bd9872 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Getting quotas for user 03812cff7628436f952ea5be41420297 and project e45a42292fe94dccaa14ba6bc41ded09. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:29:25.079864 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-321e1608-8bcd-4260-8bc7-f7e648bd9872 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Going to run 1 instances... {{(pid=120448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 05:29:25.082053 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-321e1608-8bcd-4260-8bc7-f7e648bd9872 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cd6b57c5-6b02-48fc-b0a1-fb8bc2e67d9b',volume_size=None,volume_type=None)] {{(pid=120448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 05:29:25.215320 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-321e1608-8bcd-4260-8bc7-f7e648bd9872 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.835343 Sep 02 05:29:25.216153 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 371/743] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Sep 2 05:29:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 05:29:25.228891 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5f250a54-d274-44f9-98c9-c65f0dba1333 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:25.229580 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5f250a54-d274-44f9-98c9-c65f0dba1333 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:25.288526 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5f250a54-d274-44f9-98c9-c65f0dba1333 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:25.295381 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5f250a54-d274-44f9-98c9-c65f0dba1333 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1095 microversion: 2.1 time: 0.071984 Sep 02 05:29:25.296147 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 373/744] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:25 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:26.317489 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-29e8ac85-545c-4cdb-a897-1c9414acb45e tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:26.318151 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-29e8ac85-545c-4cdb-a897-1c9414acb45e tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:26.324739 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-29e8ac85-545c-4cdb-a897-1c9414acb45e tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:26.325409 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-29e8ac85-545c-4cdb-a897-1c9414acb45e tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:26.325841 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-29e8ac85-545c-4cdb-a897-1c9414acb45e tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:26.326527 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-29e8ac85-545c-4cdb-a897-1c9414acb45e tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:26.326974 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-29e8ac85-545c-4cdb-a897-1c9414acb45e tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:26.327376 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-29e8ac85-545c-4cdb-a897-1c9414acb45e tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:26.388953 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-29e8ac85-545c-4cdb-a897-1c9414acb45e tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:26.397044 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-29e8ac85-545c-4cdb-a897-1c9414acb45e tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1193 microversion: 2.1 time: 0.083913 Sep 02 05:29:26.397613 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 372/745] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:26 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1193 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:27.418014 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-0f2ac38b-fcbf-478e-bc30-4364cd54c13e tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:27.418638 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-0f2ac38b-fcbf-478e-bc30-4364cd54c13e tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:27.425845 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0f2ac38b-fcbf-478e-bc30-4364cd54c13e tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:27.426272 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0f2ac38b-fcbf-478e-bc30-4364cd54c13e tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:27.426707 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0f2ac38b-fcbf-478e-bc30-4364cd54c13e tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:27.427432 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0f2ac38b-fcbf-478e-bc30-4364cd54c13e tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:27.428073 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0f2ac38b-fcbf-478e-bc30-4364cd54c13e tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:27.428519 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0f2ac38b-fcbf-478e-bc30-4364cd54c13e tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:27.513386 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-0f2ac38b-fcbf-478e-bc30-4364cd54c13e tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:27.521625 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-0f2ac38b-fcbf-478e-bc30-4364cd54c13e tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1211 microversion: 2.1 time: 0.107516 Sep 02 05:29:27.522681 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 374/746] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:27 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1211 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:28.514127 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-d7ded5f5-7373-4f08-899e-1aaec2151fa8 req-13cf8f4f-4fa6-4209-b793-781b30cc28b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b554b98c-26dd-444a-9b8b-9c2a887babb4", "tag": "2c730910-8785-43cc-9e4e-9d35a7b820c1"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:29:28.523406 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-d7ded5f5-7373-4f08-899e-1aaec2151fa8 req-13cf8f4f-4fa6-4209-b793-781b30cc28b5 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:28.523885 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-d7ded5f5-7373-4f08-899e-1aaec2151fa8 req-13cf8f4f-4fa6-4209-b793-781b30cc28b5 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:28.524338 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-d7ded5f5-7373-4f08-899e-1aaec2151fa8 req-13cf8f4f-4fa6-4209-b793-781b30cc28b5 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:28.534757 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-d7ded5f5-7373-4f08-899e-1aaec2151fa8 req-13cf8f4f-4fa6-4209-b793-781b30cc28b5 service nova] Creating event network-changed:2c730910-8785-43cc-9e4e-9d35a7b820c1 for instance b554b98c-26dd-444a-9b8b-9c2a887babb4 on hv-cinder-85391 Sep 02 05:29:28.542934 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-6320855d-dbb2-4ac1-924a-dc1134d5953f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:28.543315 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-6320855d-dbb2-4ac1-924a-dc1134d5953f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:28.548072 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-d7ded5f5-7373-4f08-899e-1aaec2151fa8 req-13cf8f4f-4fa6-4209-b793-781b30cc28b5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107311 Sep 02 05:29:28.548683 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 373/747] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:29:28.549942 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6320855d-dbb2-4ac1-924a-dc1134d5953f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:28.550529 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6320855d-dbb2-4ac1-924a-dc1134d5953f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:28.550991 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6320855d-dbb2-4ac1-924a-dc1134d5953f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:28.551675 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6320855d-dbb2-4ac1-924a-dc1134d5953f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:28.552192 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6320855d-dbb2-4ac1-924a-dc1134d5953f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:28.552620 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6320855d-dbb2-4ac1-924a-dc1134d5953f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:28.789244 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-6320855d-dbb2-4ac1-924a-dc1134d5953f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:28.797388 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-6320855d-dbb2-4ac1-924a-dc1134d5953f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1278 microversion: 2.1 time: 0.258417 Sep 02 05:29:28.797954 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 375/748] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:28 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1278 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:29:29.819568 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-c35d60dd-8bc0-4981-8b52-aa495479e2ce tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:29.820330 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-c35d60dd-8bc0-4981-8b52-aa495479e2ce tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:29.826695 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c35d60dd-8bc0-4981-8b52-aa495479e2ce tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:29.827182 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c35d60dd-8bc0-4981-8b52-aa495479e2ce tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:29.827614 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c35d60dd-8bc0-4981-8b52-aa495479e2ce tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:29.828334 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c35d60dd-8bc0-4981-8b52-aa495479e2ce tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:29.828819 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c35d60dd-8bc0-4981-8b52-aa495479e2ce tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:29.829239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c35d60dd-8bc0-4981-8b52-aa495479e2ce tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:29.960024 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c35d60dd-8bc0-4981-8b52-aa495479e2ce tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:29.968146 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-c35d60dd-8bc0-4981-8b52-aa495479e2ce tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1278 microversion: 2.1 time: 0.153569 Sep 02 05:29:29.968756 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 374/749] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:29 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:30.992911 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-9e411792-f4db-4e2a-8a00-0c428a168a69 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:30.993725 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-9e411792-f4db-4e2a-8a00-0c428a168a69 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:31.004988 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9e411792-f4db-4e2a-8a00-0c428a168a69 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:31.005841 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9e411792-f4db-4e2a-8a00-0c428a168a69 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:31.006571 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9e411792-f4db-4e2a-8a00-0c428a168a69 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:31.007721 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9e411792-f4db-4e2a-8a00-0c428a168a69 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:31.008544 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9e411792-f4db-4e2a-8a00-0c428a168a69 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:31.009245 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9e411792-f4db-4e2a-8a00-0c428a168a69 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:31.158682 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-9e411792-f4db-4e2a-8a00-0c428a168a69 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:31.168271 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-9e411792-f4db-4e2a-8a00-0c428a168a69 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1278 microversion: 2.1 time: 0.182474 Sep 02 05:29:31.168857 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 376/750] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:30 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1278 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:32.031158 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-6b4ebe66-202b-4137-9a4d-7a185dfb6eef tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:29:32.038013 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6b4ebe66-202b-4137-9a4d-7a185dfb6eef tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:32.038500 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6b4ebe66-202b-4137-9a4d-7a185dfb6eef tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:32.038934 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6b4ebe66-202b-4137-9a4d-7a185dfb6eef tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:32.099088 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-6b4ebe66-202b-4137-9a4d-7a185dfb6eef tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Going to try to stop instance {{(pid=120448) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 02 05:29:32.148712 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-6b4ebe66-202b-4137-9a4d-7a185dfb6eef tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "POST /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27/action" status: 202 len: 0 microversion: 2.1 time: 0.121121 Sep 02 05:29:32.149321 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 375/751] 10.222.0.30 () {60 vars in 1278 bytes} [Fri Sep 2 05:29:32 2022] POST /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:29:32.159324 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-deee0a97-aee5-4c79-a4b1-286a0986232c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:32.160062 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-deee0a97-aee5-4c79-a4b1-286a0986232c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:32.167156 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-deee0a97-aee5-4c79-a4b1-286a0986232c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:32.168025 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-deee0a97-aee5-4c79-a4b1-286a0986232c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:32.168889 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-deee0a97-aee5-4c79-a4b1-286a0986232c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:32.169792 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-deee0a97-aee5-4c79-a4b1-286a0986232c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:32.170471 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-deee0a97-aee5-4c79-a4b1-286a0986232c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:32.170900 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-deee0a97-aee5-4c79-a4b1-286a0986232c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:32.190348 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-4cf0a81e-3ef0-4594-b5ea-c3a967180442 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:32.191054 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-4cf0a81e-3ef0-4594-b5ea-c3a967180442 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:32.197499 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4cf0a81e-3ef0-4594-b5ea-c3a967180442 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:32.197981 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4cf0a81e-3ef0-4594-b5ea-c3a967180442 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:32.199073 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4cf0a81e-3ef0-4594-b5ea-c3a967180442 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:32.199739 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4cf0a81e-3ef0-4594-b5ea-c3a967180442 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:32.200222 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4cf0a81e-3ef0-4594-b5ea-c3a967180442 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:32.200651 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4cf0a81e-3ef0-4594-b5ea-c3a967180442 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:32.350585 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-deee0a97-aee5-4c79-a4b1-286a0986232c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:32.359189 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-deee0a97-aee5-4c79-a4b1-286a0986232c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1723 microversion: 2.1 time: 0.204925 Sep 02 05:29:32.359770 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 377/752] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:32 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:32.380006 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-4cf0a81e-3ef0-4594-b5ea-c3a967180442 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:32.387942 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-4cf0a81e-3ef0-4594-b5ea-c3a967180442 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1278 microversion: 2.1 time: 0.201897 Sep 02 05:29:32.388554 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 376/753] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:32 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1278 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:33.384924 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-64537a2b-6cfb-4c3c-9991-98cbb950ce5e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:33.385921 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-64537a2b-6cfb-4c3c-9991-98cbb950ce5e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:33.396534 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-64537a2b-6cfb-4c3c-9991-98cbb950ce5e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:33.397019 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-64537a2b-6cfb-4c3c-9991-98cbb950ce5e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:33.397452 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-64537a2b-6cfb-4c3c-9991-98cbb950ce5e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:33.398172 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-64537a2b-6cfb-4c3c-9991-98cbb950ce5e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:33.398624 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-64537a2b-6cfb-4c3c-9991-98cbb950ce5e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:33.399058 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-64537a2b-6cfb-4c3c-9991-98cbb950ce5e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:33.408866 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-64a50551-a43a-4506-9ca8-5f0ba04431a2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:33.409477 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-64a50551-a43a-4506-9ca8-5f0ba04431a2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:33.416149 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-64a50551-a43a-4506-9ca8-5f0ba04431a2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:33.416639 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-64a50551-a43a-4506-9ca8-5f0ba04431a2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:33.417068 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-64a50551-a43a-4506-9ca8-5f0ba04431a2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:33.417747 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-64a50551-a43a-4506-9ca8-5f0ba04431a2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:33.418188 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-64a50551-a43a-4506-9ca8-5f0ba04431a2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:33.418606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-64a50551-a43a-4506-9ca8-5f0ba04431a2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:33.604357 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-64537a2b-6cfb-4c3c-9991-98cbb950ce5e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:33.612882 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-64537a2b-6cfb-4c3c-9991-98cbb950ce5e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1723 microversion: 2.1 time: 0.234392 Sep 02 05:29:33.613093 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-64a50551-a43a-4506-9ca8-5f0ba04431a2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:33.613437 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 378/754] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:33 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:33.621579 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-64a50551-a43a-4506-9ca8-5f0ba04431a2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1266 microversion: 2.1 time: 0.216547 Sep 02 05:29:33.622191 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 377/755] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:33 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:34.638091 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-1e56b394-5331-4695-943a-1532e2efedf1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:34.639077 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-1e56b394-5331-4695-943a-1532e2efedf1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:34.646295 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f2d0a9bf-ab9c-4276-b7af-30019282ad8e tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:34.647213 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f2d0a9bf-ab9c-4276-b7af-30019282ad8e tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:34.650039 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1e56b394-5331-4695-943a-1532e2efedf1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:34.650845 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1e56b394-5331-4695-943a-1532e2efedf1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:34.651593 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1e56b394-5331-4695-943a-1532e2efedf1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:34.652711 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1e56b394-5331-4695-943a-1532e2efedf1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:34.653457 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1e56b394-5331-4695-943a-1532e2efedf1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:34.654149 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1e56b394-5331-4695-943a-1532e2efedf1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:34.657505 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f2d0a9bf-ab9c-4276-b7af-30019282ad8e tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:34.658313 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f2d0a9bf-ab9c-4276-b7af-30019282ad8e tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:34.659026 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f2d0a9bf-ab9c-4276-b7af-30019282ad8e tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:34.660205 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f2d0a9bf-ab9c-4276-b7af-30019282ad8e tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:34.660924 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f2d0a9bf-ab9c-4276-b7af-30019282ad8e tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:34.661687 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f2d0a9bf-ab9c-4276-b7af-30019282ad8e tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:34.855685 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1e56b394-5331-4695-943a-1532e2efedf1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:34.859049 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f2d0a9bf-ab9c-4276-b7af-30019282ad8e tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:34.863994 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-1e56b394-5331-4695-943a-1532e2efedf1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1723 microversion: 2.1 time: 0.232358 Sep 02 05:29:34.865097 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 379/756] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:34 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:34.867360 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f2d0a9bf-ab9c-4276-b7af-30019282ad8e tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1266 microversion: 2.1 time: 0.227604 Sep 02 05:29:34.867955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 378/757] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:34 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:35.891392 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-bae27476-a874-4c16-8bae-e6b17b692446 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:35.892320 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-5af24397-fae4-4271-a60b-9e64906a2743 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:35.892944 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-bae27476-a874-4c16-8bae-e6b17b692446 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:35.893130 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-5af24397-fae4-4271-a60b-9e64906a2743 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:35.895643 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell0:SELECT=2 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:35.895921 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell0:SELECT=2 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:35.897170 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell0:SELECT=6 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:35.906385 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bae27476-a874-4c16-8bae-e6b17b692446 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:35.907196 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bae27476-a874-4c16-8bae-e6b17b692446 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:35.907925 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bae27476-a874-4c16-8bae-e6b17b692446 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:35.908385 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5af24397-fae4-4271-a60b-9e64906a2743 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:35.909130 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bae27476-a874-4c16-8bae-e6b17b692446 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:35.909327 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5af24397-fae4-4271-a60b-9e64906a2743 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:35.909884 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bae27476-a874-4c16-8bae-e6b17b692446 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:35.910075 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5af24397-fae4-4271-a60b-9e64906a2743 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:35.910648 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bae27476-a874-4c16-8bae-e6b17b692446 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:35.911104 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5af24397-fae4-4271-a60b-9e64906a2743 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:35.911749 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5af24397-fae4-4271-a60b-9e64906a2743 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:35.912147 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5af24397-fae4-4271-a60b-9e64906a2743 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:36.104005 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-bae27476-a874-4c16-8bae-e6b17b692446 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:36.108804 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-5af24397-fae4-4271-a60b-9e64906a2743 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:36.113894 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-bae27476-a874-4c16-8bae-e6b17b692446 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1723 microversion: 2.1 time: 0.229031 Sep 02 05:29:36.115070 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 380/758] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:35 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:36.118057 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-5af24397-fae4-4271-a60b-9e64906a2743 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1266 microversion: 2.1 time: 0.232793 Sep 02 05:29:36.118836 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 379/759] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:35 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:37.141985 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ef3dee9e-98fd-4bc8-a941-1df8a0fa26f6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:37.142967 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-ef3dee9e-98fd-4bc8-a941-1df8a0fa26f6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:37.143136 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-9c547e6d-78dc-4b57-b877-32c600327e0b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:37.144156 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-9c547e6d-78dc-4b57-b877-32c600327e0b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:37.151347 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ef3dee9e-98fd-4bc8-a941-1df8a0fa26f6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:37.151552 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9c547e6d-78dc-4b57-b877-32c600327e0b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:37.151820 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9c547e6d-78dc-4b57-b877-32c600327e0b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:37.151963 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ef3dee9e-98fd-4bc8-a941-1df8a0fa26f6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:37.152317 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9c547e6d-78dc-4b57-b877-32c600327e0b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:37.152467 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ef3dee9e-98fd-4bc8-a941-1df8a0fa26f6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:37.152965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ef3dee9e-98fd-4bc8-a941-1df8a0fa26f6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:37.153135 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9c547e6d-78dc-4b57-b877-32c600327e0b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:37.153410 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ef3dee9e-98fd-4bc8-a941-1df8a0fa26f6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:37.153569 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9c547e6d-78dc-4b57-b877-32c600327e0b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:37.153825 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ef3dee9e-98fd-4bc8-a941-1df8a0fa26f6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:37.153983 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9c547e6d-78dc-4b57-b877-32c600327e0b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:37.347096 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ef3dee9e-98fd-4bc8-a941-1df8a0fa26f6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:37.350651 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-9c547e6d-78dc-4b57-b877-32c600327e0b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:37.355771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-ef3dee9e-98fd-4bc8-a941-1df8a0fa26f6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1723 microversion: 2.1 time: 0.220361 Sep 02 05:29:37.356463 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 381/760] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:37 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:37.358688 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-9c547e6d-78dc-4b57-b877-32c600327e0b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1266 microversion: 2.1 time: 0.222340 Sep 02 05:29:37.359343 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 380/761] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:37 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:38.381580 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-a779cdfb-5708-41c2-a221-2fccf5ed9769 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:38.382134 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-bc325d28-c958-4671-a00b-df1892335c24 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:38.382516 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-a779cdfb-5708-41c2-a221-2fccf5ed9769 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:38.382620 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-bc325d28-c958-4671-a00b-df1892335c24 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:38.388941 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a779cdfb-5708-41c2-a221-2fccf5ed9769 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:38.389309 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-bc325d28-c958-4671-a00b-df1892335c24 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:38.389453 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a779cdfb-5708-41c2-a221-2fccf5ed9769 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:38.389800 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-bc325d28-c958-4671-a00b-df1892335c24 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:38.389946 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a779cdfb-5708-41c2-a221-2fccf5ed9769 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:38.390233 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-bc325d28-c958-4671-a00b-df1892335c24 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:38.390488 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a779cdfb-5708-41c2-a221-2fccf5ed9769 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:38.390926 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-bc325d28-c958-4671-a00b-df1892335c24 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:38.391071 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a779cdfb-5708-41c2-a221-2fccf5ed9769 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:38.391361 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a779cdfb-5708-41c2-a221-2fccf5ed9769 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:38.391517 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-bc325d28-c958-4671-a00b-df1892335c24 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:38.391785 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-bc325d28-c958-4671-a00b-df1892335c24 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:38.576026 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-a779cdfb-5708-41c2-a221-2fccf5ed9769 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:38.584846 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-a779cdfb-5708-41c2-a221-2fccf5ed9769 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1723 microversion: 2.1 time: 0.209151 Sep 02 05:29:38.585422 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 382/762] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:38 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:38.589407 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-bc325d28-c958-4671-a00b-df1892335c24 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:38.597207 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-bc325d28-c958-4671-a00b-df1892335c24 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1266 microversion: 2.1 time: 0.220996 Sep 02 05:29:38.597767 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 381/763] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:38 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:39.606480 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-a306c553-200b-4c14-9de7-e0bb45650166 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:39.607064 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-a306c553-200b-4c14-9de7-e0bb45650166 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:39.614759 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a306c553-200b-4c14-9de7-e0bb45650166 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:39.615251 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a306c553-200b-4c14-9de7-e0bb45650166 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:39.615696 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a306c553-200b-4c14-9de7-e0bb45650166 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:39.616424 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a306c553-200b-4c14-9de7-e0bb45650166 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:39.616883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a306c553-200b-4c14-9de7-e0bb45650166 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:39.617308 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a306c553-200b-4c14-9de7-e0bb45650166 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:39.618500 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-31357f74-62c8-4c87-ba17-2d73e7db848f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:39.619115 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-31357f74-62c8-4c87-ba17-2d73e7db848f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:39.626035 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-31357f74-62c8-4c87-ba17-2d73e7db848f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:39.626523 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-31357f74-62c8-4c87-ba17-2d73e7db848f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:39.626965 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-31357f74-62c8-4c87-ba17-2d73e7db848f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:39.627659 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-31357f74-62c8-4c87-ba17-2d73e7db848f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:39.628207 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-31357f74-62c8-4c87-ba17-2d73e7db848f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:39.628547 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-31357f74-62c8-4c87-ba17-2d73e7db848f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:39.815978 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-a306c553-200b-4c14-9de7-e0bb45650166 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:39.819826 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-31357f74-62c8-4c87-ba17-2d73e7db848f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:39.824632 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-a306c553-200b-4c14-9de7-e0bb45650166 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1723 microversion: 2.1 time: 0.222063 Sep 02 05:29:39.825213 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 383/764] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:39 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:39.827851 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-31357f74-62c8-4c87-ba17-2d73e7db848f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1266 microversion: 2.1 time: 0.213778 Sep 02 05:29:39.828422 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 382/765] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:39 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:40.849806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-1622e161-9a51-4ffd-b2fb-cd47bed8aea9 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:40.850812 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-1622e161-9a51-4ffd-b2fb-cd47bed8aea9 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:40.853829 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f206caf8-fa16-4d5c-8360-260507fa2841 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:40.854908 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f206caf8-fa16-4d5c-8360-260507fa2841 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:40.861494 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1622e161-9a51-4ffd-b2fb-cd47bed8aea9 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:40.862303 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1622e161-9a51-4ffd-b2fb-cd47bed8aea9 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:40.862996 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1622e161-9a51-4ffd-b2fb-cd47bed8aea9 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:40.864558 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1622e161-9a51-4ffd-b2fb-cd47bed8aea9 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:40.865289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1622e161-9a51-4ffd-b2fb-cd47bed8aea9 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:40.865636 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f206caf8-fa16-4d5c-8360-260507fa2841 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:40.866047 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1622e161-9a51-4ffd-b2fb-cd47bed8aea9 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:40.866413 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f206caf8-fa16-4d5c-8360-260507fa2841 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:40.866843 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f206caf8-fa16-4d5c-8360-260507fa2841 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:40.867535 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f206caf8-fa16-4d5c-8360-260507fa2841 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:40.868029 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f206caf8-fa16-4d5c-8360-260507fa2841 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:40.868480 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f206caf8-fa16-4d5c-8360-260507fa2841 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:41.062435 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f206caf8-fa16-4d5c-8360-260507fa2841 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:41.064551 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1622e161-9a51-4ffd-b2fb-cd47bed8aea9 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:41.070966 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f206caf8-fa16-4d5c-8360-260507fa2841 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1266 microversion: 2.1 time: 0.223617 Sep 02 05:29:41.071544 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 383/766] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:40 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:41.072946 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-1622e161-9a51-4ffd-b2fb-cd47bed8aea9 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1723 microversion: 2.1 time: 0.229501 Sep 02 05:29:41.073538 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 384/767] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:40 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:42.094231 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-6e44b360-d1c8-480c-8401-ca2cc6291f87 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:42.094823 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-00bc56fb-1050-4c20-9ce2-9b4d04b551eb tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:42.095223 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-6e44b360-d1c8-480c-8401-ca2cc6291f87 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:42.095338 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-00bc56fb-1050-4c20-9ce2-9b4d04b551eb tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:42.101424 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6e44b360-d1c8-480c-8401-ca2cc6291f87 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:42.101612 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-00bc56fb-1050-4c20-9ce2-9b4d04b551eb tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:42.101912 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6e44b360-d1c8-480c-8401-ca2cc6291f87 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:42.102068 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-00bc56fb-1050-4c20-9ce2-9b4d04b551eb tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:42.102350 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-00bc56fb-1050-4c20-9ce2-9b4d04b551eb tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:42.102507 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6e44b360-d1c8-480c-8401-ca2cc6291f87 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:42.103030 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-00bc56fb-1050-4c20-9ce2-9b4d04b551eb tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:42.103173 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6e44b360-d1c8-480c-8401-ca2cc6291f87 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:42.103476 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-00bc56fb-1050-4c20-9ce2-9b4d04b551eb tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:42.103639 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6e44b360-d1c8-480c-8401-ca2cc6291f87 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:42.103888 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-00bc56fb-1050-4c20-9ce2-9b4d04b551eb tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:42.104031 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6e44b360-d1c8-480c-8401-ca2cc6291f87 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:42.299760 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-00bc56fb-1050-4c20-9ce2-9b4d04b551eb tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:42.303297 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-6e44b360-d1c8-480c-8401-ca2cc6291f87 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:42.308848 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-00bc56fb-1050-4c20-9ce2-9b4d04b551eb tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1723 microversion: 2.1 time: 0.218230 Sep 02 05:29:42.309436 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 385/768] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:42 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:42.311498 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-6e44b360-d1c8-480c-8401-ca2cc6291f87 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1266 microversion: 2.1 time: 0.221954 Sep 02 05:29:42.312043 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 384/769] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:42 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:43.330182 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5431de2a-f99f-4128-96dd-f85e4bad971c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:43.330771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5431de2a-f99f-4128-96dd-f85e4bad971c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:43.332228 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-67884689-c5c0-4d11-8708-d62d3ea37d3d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:43.332875 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-67884689-c5c0-4d11-8708-d62d3ea37d3d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:43.337670 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5431de2a-f99f-4128-96dd-f85e4bad971c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:43.338148 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5431de2a-f99f-4128-96dd-f85e4bad971c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:43.338605 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5431de2a-f99f-4128-96dd-f85e4bad971c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:43.339285 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5431de2a-f99f-4128-96dd-f85e4bad971c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:43.339427 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-67884689-c5c0-4d11-8708-d62d3ea37d3d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:43.339731 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5431de2a-f99f-4128-96dd-f85e4bad971c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:43.339895 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-67884689-c5c0-4d11-8708-d62d3ea37d3d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:43.340139 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5431de2a-f99f-4128-96dd-f85e4bad971c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:43.340376 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-67884689-c5c0-4d11-8708-d62d3ea37d3d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:43.341070 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-67884689-c5c0-4d11-8708-d62d3ea37d3d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:43.341528 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-67884689-c5c0-4d11-8708-d62d3ea37d3d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:43.341951 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-67884689-c5c0-4d11-8708-d62d3ea37d3d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:43.529980 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5431de2a-f99f-4128-96dd-f85e4bad971c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:43.533634 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-67884689-c5c0-4d11-8708-d62d3ea37d3d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:43.540798 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5431de2a-f99f-4128-96dd-f85e4bad971c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1723 microversion: 2.1 time: 0.214491 Sep 02 05:29:43.542195 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-67884689-c5c0-4d11-8708-d62d3ea37d3d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1266 microversion: 2.1 time: 0.213902 Sep 02 05:29:43.542743 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 385/770] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:43 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:43.544527 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 386/771] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:43 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:44.566359 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-632b205b-db36-4729-968c-4a95a3822d2f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:44.567266 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-1790c5b8-8514-4fa9-bd5d-f1aa3776aed2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:44.567858 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-1790c5b8-8514-4fa9-bd5d-f1aa3776aed2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:44.568049 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-632b205b-db36-4729-968c-4a95a3822d2f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:44.577828 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-632b205b-db36-4729-968c-4a95a3822d2f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:44.578151 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1790c5b8-8514-4fa9-bd5d-f1aa3776aed2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:44.578661 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-632b205b-db36-4729-968c-4a95a3822d2f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:44.578948 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1790c5b8-8514-4fa9-bd5d-f1aa3776aed2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:44.579382 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-632b205b-db36-4729-968c-4a95a3822d2f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:44.579644 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1790c5b8-8514-4fa9-bd5d-f1aa3776aed2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:44.580570 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-632b205b-db36-4729-968c-4a95a3822d2f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:44.580865 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1790c5b8-8514-4fa9-bd5d-f1aa3776aed2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:44.581366 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-632b205b-db36-4729-968c-4a95a3822d2f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:44.581624 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1790c5b8-8514-4fa9-bd5d-f1aa3776aed2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:44.582036 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-632b205b-db36-4729-968c-4a95a3822d2f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:44.582341 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1790c5b8-8514-4fa9-bd5d-f1aa3776aed2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:44.776220 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1790c5b8-8514-4fa9-bd5d-f1aa3776aed2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:44.780191 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-632b205b-db36-4729-968c-4a95a3822d2f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:44.784073 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-1790c5b8-8514-4fa9-bd5d-f1aa3776aed2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1266 microversion: 2.1 time: 0.224097 Sep 02 05:29:44.784710 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 387/772] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:44 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:44.788669 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-632b205b-db36-4729-968c-4a95a3822d2f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1723 microversion: 2.1 time: 0.228709 Sep 02 05:29:44.789281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 386/773] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:44 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:45.512881 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-6b0032e1-ec84-4715-abfb-a9454d96b1d7 req-02e8c397-9921-4568-b295-c33504e18448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b554b98c-26dd-444a-9b8b-9c2a887babb4", "name": "network-vif-plugged", "status": "completed", "tag": "2c730910-8785-43cc-9e4e-9d35a7b820c1"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:29:45.522922 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-6b0032e1-ec84-4715-abfb-a9454d96b1d7 req-02e8c397-9921-4568-b295-c33504e18448 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:45.523399 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-6b0032e1-ec84-4715-abfb-a9454d96b1d7 req-02e8c397-9921-4568-b295-c33504e18448 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:45.523821 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-6b0032e1-ec84-4715-abfb-a9454d96b1d7 req-02e8c397-9921-4568-b295-c33504e18448 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:45.527678 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:45.535537 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-6b0032e1-ec84-4715-abfb-a9454d96b1d7 req-02e8c397-9921-4568-b295-c33504e18448 service nova] Creating event network-vif-plugged:2c730910-8785-43cc-9e4e-9d35a7b820c1 for instance b554b98c-26dd-444a-9b8b-9c2a887babb4 on hv-cinder-85391 Sep 02 05:29:45.540858 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-6b0032e1-ec84-4715-abfb-a9454d96b1d7 req-02e8c397-9921-4568-b295-c33504e18448 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091749 Sep 02 05:29:45.541493 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 388/774] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:29:45.670177 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-050ca8d5-9b99-455c-a6cc-ba65d1bc8249 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f0274e3-5836-4d94-b281-31268626f7da"}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:29:45.672661 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-050ca8d5-9b99-455c-a6cc-ba65d1bc8249 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:45.679029 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-050ca8d5-9b99-455c-a6cc-ba65d1bc8249 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:45.679511 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-050ca8d5-9b99-455c-a6cc-ba65d1bc8249 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:45.679944 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-050ca8d5-9b99-455c-a6cc-ba65d1bc8249 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:45.680734 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-050ca8d5-9b99-455c-a6cc-ba65d1bc8249 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:45.681186 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-050ca8d5-9b99-455c-a6cc-ba65d1bc8249 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:45.681612 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-050ca8d5-9b99-455c-a6cc-ba65d1bc8249 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:45.685281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:45.806655 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-34d37f79-e82e-42e6-9ad2-2db00092e17f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:45.807519 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-34d37f79-e82e-42e6-9ad2-2db00092e17f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:45.814980 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-34d37f79-e82e-42e6-9ad2-2db00092e17f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:45.815301 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-34d37f79-e82e-42e6-9ad2-2db00092e17f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:45.816166 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-34d37f79-e82e-42e6-9ad2-2db00092e17f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:45.816911 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-34d37f79-e82e-42e6-9ad2-2db00092e17f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:45.817380 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-34d37f79-e82e-42e6-9ad2-2db00092e17f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:45.817781 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-34d37f79-e82e-42e6-9ad2-2db00092e17f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:45.960331 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-050ca8d5-9b99-455c-a6cc-ba65d1bc8249 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "POST /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.398733 Sep 02 05:29:45.961093 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 387/775] 10.222.0.30 () {60 vars in 1323 bytes} [Fri Sep 2 05:29:45 2022] POST /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455/os-volume_attachments => generated 194 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:29:45.966759 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-3a9079da-ede7-4b5f-9a8b-1cac323e7728 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:45.967746 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-3a9079da-ede7-4b5f-9a8b-1cac323e7728 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:45.974387 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3a9079da-ede7-4b5f-9a8b-1cac323e7728 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:45.974887 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3a9079da-ede7-4b5f-9a8b-1cac323e7728 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:45.975320 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3a9079da-ede7-4b5f-9a8b-1cac323e7728 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:45.976035 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3a9079da-ede7-4b5f-9a8b-1cac323e7728 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:45.976518 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3a9079da-ede7-4b5f-9a8b-1cac323e7728 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:45.976968 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3a9079da-ede7-4b5f-9a8b-1cac323e7728 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:46.245491 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-34d37f79-e82e-42e6-9ad2-2db00092e17f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:46.253507 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-34d37f79-e82e-42e6-9ad2-2db00092e17f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1266 microversion: 2.1 time: 0.451936 Sep 02 05:29:46.254355 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 389/776] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:45 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1266 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:29:46.308193 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-3a9079da-ede7-4b5f-9a8b-1cac323e7728 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:46.320208 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-3a9079da-ede7-4b5f-9a8b-1cac323e7728 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1723 microversion: 2.1 time: 0.357485 Sep 02 05:29:46.320977 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 388/777] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:45 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1723 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:47.274629 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-a78d5570-44ce-4692-80ab-0115dc5e8ae1 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:47.275294 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-a78d5570-44ce-4692-80ab-0115dc5e8ae1 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:47.289351 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a78d5570-44ce-4692-80ab-0115dc5e8ae1 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:47.289774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a78d5570-44ce-4692-80ab-0115dc5e8ae1 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:47.290208 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a78d5570-44ce-4692-80ab-0115dc5e8ae1 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:47.290907 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a78d5570-44ce-4692-80ab-0115dc5e8ae1 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:47.291364 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a78d5570-44ce-4692-80ab-0115dc5e8ae1 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:47.291791 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a78d5570-44ce-4692-80ab-0115dc5e8ae1 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:47.341951 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-0421dc5d-5fca-4654-b878-f84340d08586 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:47.342559 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-0421dc5d-5fca-4654-b878-f84340d08586 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:47.349322 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0421dc5d-5fca-4654-b878-f84340d08586 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:47.349812 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0421dc5d-5fca-4654-b878-f84340d08586 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:47.350364 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0421dc5d-5fca-4654-b878-f84340d08586 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:47.351093 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0421dc5d-5fca-4654-b878-f84340d08586 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:47.351619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0421dc5d-5fca-4654-b878-f84340d08586 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:47.352048 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0421dc5d-5fca-4654-b878-f84340d08586 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:47.485533 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-a78d5570-44ce-4692-80ab-0115dc5e8ae1 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:47.493957 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-a78d5570-44ce-4692-80ab-0115dc5e8ae1 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1266 microversion: 2.1 time: 0.223305 Sep 02 05:29:47.494778 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 390/778] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:47 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:47.522910 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-0421dc5d-5fca-4654-b878-f84340d08586 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:47.532869 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-0421dc5d-5fca-4654-b878-f84340d08586 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1723 microversion: 2.1 time: 0.195063 Sep 02 05:29:47.533460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 389/779] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:47 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:48.517945 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-c58715c0-7a25-4e48-bd60-9403a006e08b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:48.518537 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-c58715c0-7a25-4e48-bd60-9403a006e08b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:48.525480 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c58715c0-7a25-4e48-bd60-9403a006e08b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:48.525966 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c58715c0-7a25-4e48-bd60-9403a006e08b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:48.526430 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c58715c0-7a25-4e48-bd60-9403a006e08b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:48.527119 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c58715c0-7a25-4e48-bd60-9403a006e08b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:48.527552 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c58715c0-7a25-4e48-bd60-9403a006e08b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:48.528014 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c58715c0-7a25-4e48-bd60-9403a006e08b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:48.554077 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-5e028afb-7ffe-48e2-a60e-91ca756d95b9 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:48.554745 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-5e028afb-7ffe-48e2-a60e-91ca756d95b9 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:48.561851 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5e028afb-7ffe-48e2-a60e-91ca756d95b9 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:48.562339 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5e028afb-7ffe-48e2-a60e-91ca756d95b9 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:48.562799 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5e028afb-7ffe-48e2-a60e-91ca756d95b9 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:48.563508 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5e028afb-7ffe-48e2-a60e-91ca756d95b9 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:48.563957 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5e028afb-7ffe-48e2-a60e-91ca756d95b9 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:48.564412 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5e028afb-7ffe-48e2-a60e-91ca756d95b9 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:48.717463 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-c58715c0-7a25-4e48-bd60-9403a006e08b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:48.725805 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-c58715c0-7a25-4e48-bd60-9403a006e08b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1452 microversion: 2.1 time: 0.212186 Sep 02 05:29:48.726689 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 391/780] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:48 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1452 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:48.744614 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-5e028afb-7ffe-48e2-a60e-91ca756d95b9 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:48.746202 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-b55c46d8-af84-4ce8-ad7b-65783d44b7cd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:48.746977 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-b55c46d8-af84-4ce8-ad7b-65783d44b7cd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:48.752936 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-5e028afb-7ffe-48e2-a60e-91ca756d95b9 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1700 microversion: 2.1 time: 0.202782 Sep 02 05:29:48.753232 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b55c46d8-af84-4ce8-ad7b-65783d44b7cd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:48.753497 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 390/781] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:48 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1700 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:48.753722 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b55c46d8-af84-4ce8-ad7b-65783d44b7cd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:48.754160 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b55c46d8-af84-4ce8-ad7b-65783d44b7cd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:48.754853 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b55c46d8-af84-4ce8-ad7b-65783d44b7cd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:48.755311 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b55c46d8-af84-4ce8-ad7b-65783d44b7cd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:48.755738 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b55c46d8-af84-4ce8-ad7b-65783d44b7cd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:48.775779 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-e4d123db-b48f-43e2-ae2d-7a714ce9409e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:29:48.781970 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e4d123db-b48f-43e2-ae2d-7a714ce9409e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:48.782456 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e4d123db-b48f-43e2-ae2d-7a714ce9409e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:48.782916 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e4d123db-b48f-43e2-ae2d-7a714ce9409e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:48.810480 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-e4d123db-b48f-43e2-ae2d-7a714ce9409e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Going to try to start instance {{(pid=120448) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 02 05:29:48.856045 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-e4d123db-b48f-43e2-ae2d-7a714ce9409e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "POST /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27/action" status: 202 len: 0 microversion: 2.1 time: 0.085273 Sep 02 05:29:48.857109 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 391/782] 10.222.0.30 () {60 vars in 1278 bytes} [Fri Sep 2 05:29:48 2022] POST /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:29:48.865496 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-3951fcae-7e9e-4ab0-825a-8c08dcbdadb6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:48.866239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-3951fcae-7e9e-4ab0-825a-8c08dcbdadb6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:48.872896 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3951fcae-7e9e-4ab0-825a-8c08dcbdadb6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:48.873771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3951fcae-7e9e-4ab0-825a-8c08dcbdadb6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:48.874634 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3951fcae-7e9e-4ab0-825a-8c08dcbdadb6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:48.875958 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3951fcae-7e9e-4ab0-825a-8c08dcbdadb6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:48.877059 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3951fcae-7e9e-4ab0-825a-8c08dcbdadb6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:48.877824 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3951fcae-7e9e-4ab0-825a-8c08dcbdadb6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:48.908976 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-b55c46d8-af84-4ce8-ad7b-65783d44b7cd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:48.918291 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-b55c46d8-af84-4ce8-ad7b-65783d44b7cd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1452 microversion: 2.1 time: 0.175925 Sep 02 05:29:48.918880 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 392/783] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:48 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1452 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:49.053342 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-3951fcae-7e9e-4ab0-825a-8c08dcbdadb6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:49.062970 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-3951fcae-7e9e-4ab0-825a-8c08dcbdadb6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1709 microversion: 2.1 time: 0.201699 Sep 02 05:29:49.068227 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 392/784] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:48 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1709 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:50.085636 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-095aef54-13fe-4952-a22a-58f1c1e3948c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:50.086300 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-095aef54-13fe-4952-a22a-58f1c1e3948c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:50.094387 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-095aef54-13fe-4952-a22a-58f1c1e3948c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:50.094875 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-095aef54-13fe-4952-a22a-58f1c1e3948c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:50.095309 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-095aef54-13fe-4952-a22a-58f1c1e3948c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:50.096041 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-095aef54-13fe-4952-a22a-58f1c1e3948c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:50.096531 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-095aef54-13fe-4952-a22a-58f1c1e3948c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:50.097163 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-095aef54-13fe-4952-a22a-58f1c1e3948c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:50.237510 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-095aef54-13fe-4952-a22a-58f1c1e3948c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:50.246824 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-095aef54-13fe-4952-a22a-58f1c1e3948c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1709 microversion: 2.1 time: 0.165258 Sep 02 05:29:50.247389 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 393/785] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:50 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1709 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:50.885830 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-52fc1f67-e0f1-44b4-820f-72ac5258fc93 req-f0a454fe-2fff-4d70-924b-22af9056ec99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b554b98c-26dd-444a-9b8b-9c2a887babb4", "tag": "2c730910-8785-43cc-9e4e-9d35a7b820c1"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:29:50.895636 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-52fc1f67-e0f1-44b4-820f-72ac5258fc93 req-f0a454fe-2fff-4d70-924b-22af9056ec99 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:50.895929 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-52fc1f67-e0f1-44b4-820f-72ac5258fc93 req-f0a454fe-2fff-4d70-924b-22af9056ec99 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:50.896392 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-52fc1f67-e0f1-44b4-820f-72ac5258fc93 req-f0a454fe-2fff-4d70-924b-22af9056ec99 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:50.907624 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-52fc1f67-e0f1-44b4-820f-72ac5258fc93 req-f0a454fe-2fff-4d70-924b-22af9056ec99 service nova] Creating event network-changed:2c730910-8785-43cc-9e4e-9d35a7b820c1 for instance b554b98c-26dd-444a-9b8b-9c2a887babb4 on hv-cinder-85391 Sep 02 05:29:50.912949 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-52fc1f67-e0f1-44b4-820f-72ac5258fc93 req-f0a454fe-2fff-4d70-924b-22af9056ec99 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082942 Sep 02 05:29:50.913557 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 393/786] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 05:29:51.267889 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-3cce11e7-a89f-47a4-928e-f0dbd23878f6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:51.268649 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-3cce11e7-a89f-47a4-928e-f0dbd23878f6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:51.275123 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3cce11e7-a89f-47a4-928e-f0dbd23878f6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:51.275619 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3cce11e7-a89f-47a4-928e-f0dbd23878f6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:51.276037 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3cce11e7-a89f-47a4-928e-f0dbd23878f6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:51.276769 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3cce11e7-a89f-47a4-928e-f0dbd23878f6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:51.277217 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3cce11e7-a89f-47a4-928e-f0dbd23878f6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:51.277635 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3cce11e7-a89f-47a4-928e-f0dbd23878f6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:51.513055 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-3cce11e7-a89f-47a4-928e-f0dbd23878f6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:51.522157 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-3cce11e7-a89f-47a4-928e-f0dbd23878f6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1713 microversion: 2.1 time: 0.258124 Sep 02 05:29:51.522854 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 394/787] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:51 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1713 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:55.702509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-ecad791d-5944-485b-8433-04f3ab20c44d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:29:55.704947 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-ecad791d-5944-485b-8433-04f3ab20c44d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:55.707721 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:55.713225 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ecad791d-5944-485b-8433-04f3ab20c44d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:55.713702 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ecad791d-5944-485b-8433-04f3ab20c44d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:55.714132 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ecad791d-5944-485b-8433-04f3ab20c44d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:55.714843 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ecad791d-5944-485b-8433-04f3ab20c44d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:55.715305 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ecad791d-5944-485b-8433-04f3ab20c44d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:55.715699 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ecad791d-5944-485b-8433-04f3ab20c44d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:55.739339 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.objects.instance [None req-ecad791d-5944-485b-8433-04f3ab20c44d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lazy-loading 'flavor' on Instance uuid dc1683c4-1646-485d-99de-4b1591af0455 {{(pid=120448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:29:55.876017 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-ecad791d-5944-485b-8433-04f3ab20c44d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "POST /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455/action" status: 200 len: 32 microversion: 2.1 time: 0.177847 Sep 02 05:29:55.876726 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 394/788] 10.222.0.30 () {60 vars in 1278 bytes} [Fri Sep 2 05:29:55 2022] POST /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 05:29:55.886287 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-c08c32ea-ce77-48a6-9926-fc8cdc63b8c3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:55.887072 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-c08c32ea-ce77-48a6-9926-fc8cdc63b8c3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:55.889823 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_api:SELECT=49 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:55.895618 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c08c32ea-ce77-48a6-9926-fc8cdc63b8c3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:55.896354 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c08c32ea-ce77-48a6-9926-fc8cdc63b8c3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:55.896618 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c08c32ea-ce77-48a6-9926-fc8cdc63b8c3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:55.897316 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c08c32ea-ce77-48a6-9926-fc8cdc63b8c3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:55.897781 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c08c32ea-ce77-48a6-9926-fc8cdc63b8c3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:55.898192 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c08c32ea-ce77-48a6-9926-fc8cdc63b8c3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:56.111340 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-c08c32ea-ce77-48a6-9926-fc8cdc63b8c3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:56.120240 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-c08c32ea-ce77-48a6-9926-fc8cdc63b8c3 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1737 microversion: 2.1 time: 0.237699 Sep 02 05:29:56.120818 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 395/789] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:55 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1737 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:57.147747 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-a965e5d9-e91c-4163-bcc6-c43e5ab4c067 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:57.148928 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-a965e5d9-e91c-4163-bcc6-c43e5ab4c067 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:57.157002 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a965e5d9-e91c-4163-bcc6-c43e5ab4c067 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:57.157476 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a965e5d9-e91c-4163-bcc6-c43e5ab4c067 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:57.157938 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a965e5d9-e91c-4163-bcc6-c43e5ab4c067 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:57.158584 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a965e5d9-e91c-4163-bcc6-c43e5ab4c067 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:57.159036 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a965e5d9-e91c-4163-bcc6-c43e5ab4c067 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:57.159460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a965e5d9-e91c-4163-bcc6-c43e5ab4c067 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:57.297179 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-a965e5d9-e91c-4163-bcc6-c43e5ab4c067 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:57.309839 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-a965e5d9-e91c-4163-bcc6-c43e5ab4c067 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1737 microversion: 2.1 time: 0.170121 Sep 02 05:29:57.310422 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 395/790] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:57 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:58.332651 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-36a1f27b-c847-4b85-beac-24d23ce22161 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:58.333315 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-36a1f27b-c847-4b85-beac-24d23ce22161 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:58.341349 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-36a1f27b-c847-4b85-beac-24d23ce22161 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:58.341920 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-36a1f27b-c847-4b85-beac-24d23ce22161 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:58.342435 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-36a1f27b-c847-4b85-beac-24d23ce22161 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:58.343250 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-36a1f27b-c847-4b85-beac-24d23ce22161 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:58.343788 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-36a1f27b-c847-4b85-beac-24d23ce22161 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:58.344337 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-36a1f27b-c847-4b85-beac-24d23ce22161 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:58.486733 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-36a1f27b-c847-4b85-beac-24d23ce22161 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:58.495625 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-36a1f27b-c847-4b85-beac-24d23ce22161 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1737 microversion: 2.1 time: 0.167627 Sep 02 05:29:58.496232 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 396/791] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:58 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:29:59.520824 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-e221b8d8-bafa-41e5-a25f-381c96dd5270 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:29:59.521778 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-e221b8d8-bafa-41e5-a25f-381c96dd5270 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:29:59.530721 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e221b8d8-bafa-41e5-a25f-381c96dd5270 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:59.531202 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e221b8d8-bafa-41e5-a25f-381c96dd5270 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:59.531632 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e221b8d8-bafa-41e5-a25f-381c96dd5270 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:59.532383 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e221b8d8-bafa-41e5-a25f-381c96dd5270 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:29:59.532803 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e221b8d8-bafa-41e5-a25f-381c96dd5270 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:29:59.533225 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e221b8d8-bafa-41e5-a25f-381c96dd5270 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:29:59.671667 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-e221b8d8-bafa-41e5-a25f-381c96dd5270 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:29:59.680594 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-e221b8d8-bafa-41e5-a25f-381c96dd5270 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1737 microversion: 2.1 time: 0.166242 Sep 02 05:29:59.681176 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 396/792] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:29:59 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:00.703633 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-28e09f70-8fe3-49f3-a00a-4177a8afb59c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:00.704293 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-28e09f70-8fe3-49f3-a00a-4177a8afb59c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:00.706310 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 05:30:00.706474 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Fri Sep 2 05:30:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 (ip 10.222.0.30) !!! Sep 02 05:30:00.713432 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-28e09f70-8fe3-49f3-a00a-4177a8afb59c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:00.713909 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-28e09f70-8fe3-49f3-a00a-4177a8afb59c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:00.714343 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-28e09f70-8fe3-49f3-a00a-4177a8afb59c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:00.715058 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-28e09f70-8fe3-49f3-a00a-4177a8afb59c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:00.715507 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-28e09f70-8fe3-49f3-a00a-4177a8afb59c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:00.715957 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-28e09f70-8fe3-49f3-a00a-4177a8afb59c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:00.869191 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-28e09f70-8fe3-49f3-a00a-4177a8afb59c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:00.877859 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-28e09f70-8fe3-49f3-a00a-4177a8afb59c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1737 microversion: 2.1 time: 0.178206 Sep 02 05:30:00.878472 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 397/793] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:00 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:01.899109 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-025dd038-b91f-41fd-a3e7-ad8d06bfa83f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:01.899786 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-025dd038-b91f-41fd-a3e7-ad8d06bfa83f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:01.906849 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-025dd038-b91f-41fd-a3e7-ad8d06bfa83f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:01.907329 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-025dd038-b91f-41fd-a3e7-ad8d06bfa83f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:01.907752 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-025dd038-b91f-41fd-a3e7-ad8d06bfa83f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:01.908475 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-025dd038-b91f-41fd-a3e7-ad8d06bfa83f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:01.908919 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-025dd038-b91f-41fd-a3e7-ad8d06bfa83f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:01.909337 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-025dd038-b91f-41fd-a3e7-ad8d06bfa83f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:02.053865 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-025dd038-b91f-41fd-a3e7-ad8d06bfa83f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:02.062678 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-025dd038-b91f-41fd-a3e7-ad8d06bfa83f tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1737 microversion: 2.1 time: 0.167460 Sep 02 05:30:02.063223 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 397/794] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:01 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:03.088626 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-af799105-d858-4fd2-988a-5b6b3766f9d8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:03.089597 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-af799105-d858-4fd2-988a-5b6b3766f9d8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:03.097151 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-af799105-d858-4fd2-988a-5b6b3766f9d8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:03.097670 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-af799105-d858-4fd2-988a-5b6b3766f9d8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:03.098134 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-af799105-d858-4fd2-988a-5b6b3766f9d8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:03.098874 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-af799105-d858-4fd2-988a-5b6b3766f9d8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:03.099349 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-af799105-d858-4fd2-988a-5b6b3766f9d8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:03.099796 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-af799105-d858-4fd2-988a-5b6b3766f9d8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:03.241913 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-af799105-d858-4fd2-988a-5b6b3766f9d8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:03.250522 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-af799105-d858-4fd2-988a-5b6b3766f9d8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1737 microversion: 2.1 time: 0.168705 Sep 02 05:30:03.251104 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 398/795] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:03 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:04.275823 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-0c84b466-8aaa-419a-b3ef-b1fe0b624a47 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:04.276844 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-0c84b466-8aaa-419a-b3ef-b1fe0b624a47 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:04.287566 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0c84b466-8aaa-419a-b3ef-b1fe0b624a47 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:04.288427 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0c84b466-8aaa-419a-b3ef-b1fe0b624a47 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:04.289204 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0c84b466-8aaa-419a-b3ef-b1fe0b624a47 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:04.290345 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0c84b466-8aaa-419a-b3ef-b1fe0b624a47 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:04.291091 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0c84b466-8aaa-419a-b3ef-b1fe0b624a47 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:04.291883 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0c84b466-8aaa-419a-b3ef-b1fe0b624a47 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:04.428337 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-0c84b466-8aaa-419a-b3ef-b1fe0b624a47 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:04.437389 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-0c84b466-8aaa-419a-b3ef-b1fe0b624a47 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1737 microversion: 2.1 time: 0.168088 Sep 02 05:30:04.437969 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 398/796] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:04 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:05.462525 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-deee13cd-94d3-489b-8996-3fd447d5cdc8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:05.463487 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-deee13cd-94d3-489b-8996-3fd447d5cdc8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:05.471186 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-deee13cd-94d3-489b-8996-3fd447d5cdc8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:05.471691 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-deee13cd-94d3-489b-8996-3fd447d5cdc8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:05.472153 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-deee13cd-94d3-489b-8996-3fd447d5cdc8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:05.472889 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-deee13cd-94d3-489b-8996-3fd447d5cdc8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:05.473358 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-deee13cd-94d3-489b-8996-3fd447d5cdc8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:05.473801 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-deee13cd-94d3-489b-8996-3fd447d5cdc8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:05.620310 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-deee13cd-94d3-489b-8996-3fd447d5cdc8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:05.630981 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-deee13cd-94d3-489b-8996-3fd447d5cdc8 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1737 microversion: 2.1 time: 0.174957 Sep 02 05:30:05.631595 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 399/797] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:05 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:06.422969 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-34833e96-335f-4752-b595-d11950c4fd6a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:30:06.423491 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-34833e96-335f-4752-b595-d11950c4fd6a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:06.429791 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-34833e96-335f-4752-b595-d11950c4fd6a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:06.430273 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-34833e96-335f-4752-b595-d11950c4fd6a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:06.430706 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-34833e96-335f-4752-b595-d11950c4fd6a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:06.431393 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-34833e96-335f-4752-b595-d11950c4fd6a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:06.431846 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-34833e96-335f-4752-b595-d11950c4fd6a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:06.432315 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-34833e96-335f-4752-b595-d11950c4fd6a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:06.455291 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.objects.instance [None req-34833e96-335f-4752-b595-d11950c4fd6a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lazy-loading 'flavor' on Instance uuid 9feba72e-7abe-4be7-b75e-51262eb201a1 {{(pid=120448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:30:06.474578 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:30:06.533127 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-34833e96-335f-4752-b595-d11950c4fd6a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "POST /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1/action" status: 202 len: 0 microversion: 2.1 time: 0.225556 Sep 02 05:30:06.533924 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 399/798] 10.222.0.30 () {60 vars in 1278 bytes} [Fri Sep 2 05:30:06 2022] POST /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:30:06.542387 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-66cdcc30-832b-48a2-94be-360a52b461c5 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:06.543659 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-66cdcc30-832b-48a2-94be-360a52b461c5 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:06.551008 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-66cdcc30-832b-48a2-94be-360a52b461c5 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:06.551576 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-66cdcc30-832b-48a2-94be-360a52b461c5 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:06.552076 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-66cdcc30-832b-48a2-94be-360a52b461c5 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:06.552960 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-66cdcc30-832b-48a2-94be-360a52b461c5 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:06.553574 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-66cdcc30-832b-48a2-94be-360a52b461c5 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:06.554310 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-66cdcc30-832b-48a2-94be-360a52b461c5 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:06.655455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-a50eaad2-468d-44ce-91bc-5100d28354ff tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:06.656362 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-a50eaad2-468d-44ce-91bc-5100d28354ff tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:06.662890 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a50eaad2-468d-44ce-91bc-5100d28354ff tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:06.663463 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a50eaad2-468d-44ce-91bc-5100d28354ff tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:06.663970 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a50eaad2-468d-44ce-91bc-5100d28354ff tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:06.664754 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a50eaad2-468d-44ce-91bc-5100d28354ff tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:06.665276 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a50eaad2-468d-44ce-91bc-5100d28354ff tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:06.665770 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a50eaad2-468d-44ce-91bc-5100d28354ff tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:06.693922 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-66cdcc30-832b-48a2-94be-360a52b461c5 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:06.702411 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-66cdcc30-832b-48a2-94be-360a52b461c5 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1568 microversion: 2.1 time: 0.163881 Sep 02 05:30:06.702988 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 400/799] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:06 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:06.800272 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-a50eaad2-468d-44ce-91bc-5100d28354ff tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:06.813790 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-a50eaad2-468d-44ce-91bc-5100d28354ff tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1737 microversion: 2.1 time: 0.162614 Sep 02 05:30:06.814652 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 400/800] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:06 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:07.723287 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-37e50f44-0106-4702-9e73-4ee5af0549f9 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:07.723889 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-37e50f44-0106-4702-9e73-4ee5af0549f9 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:07.731188 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-37e50f44-0106-4702-9e73-4ee5af0549f9 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:07.731736 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-37e50f44-0106-4702-9e73-4ee5af0549f9 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:07.732217 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-37e50f44-0106-4702-9e73-4ee5af0549f9 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:07.732973 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-37e50f44-0106-4702-9e73-4ee5af0549f9 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:07.733423 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-37e50f44-0106-4702-9e73-4ee5af0549f9 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:07.733838 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-37e50f44-0106-4702-9e73-4ee5af0549f9 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:07.838814 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-6a482897-7dea-4454-a747-dbd20e7c1c9e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:07.839398 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-6a482897-7dea-4454-a747-dbd20e7c1c9e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:07.846020 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6a482897-7dea-4454-a747-dbd20e7c1c9e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:07.846531 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6a482897-7dea-4454-a747-dbd20e7c1c9e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:07.847071 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6a482897-7dea-4454-a747-dbd20e7c1c9e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:07.848131 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6a482897-7dea-4454-a747-dbd20e7c1c9e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:07.848581 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6a482897-7dea-4454-a747-dbd20e7c1c9e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:07.849038 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6a482897-7dea-4454-a747-dbd20e7c1c9e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:07.866272 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-37e50f44-0106-4702-9e73-4ee5af0549f9 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:07.873962 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-37e50f44-0106-4702-9e73-4ee5af0549f9 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1568 microversion: 2.1 time: 0.154755 Sep 02 05:30:07.874837 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 401/801] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:07 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:07.978476 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-6a482897-7dea-4454-a747-dbd20e7c1c9e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:07.991730 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-6a482897-7dea-4454-a747-dbd20e7c1c9e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1737 microversion: 2.1 time: 0.156538 Sep 02 05:30:07.992535 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 401/802] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:07 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:30:08.898375 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-4647f0ea-692a-4d78-836c-bd98f2fbf2e3 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:08.898948 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-4647f0ea-692a-4d78-836c-bd98f2fbf2e3 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:08.907242 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4647f0ea-692a-4d78-836c-bd98f2fbf2e3 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:08.907724 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4647f0ea-692a-4d78-836c-bd98f2fbf2e3 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:08.908166 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4647f0ea-692a-4d78-836c-bd98f2fbf2e3 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:08.908901 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4647f0ea-692a-4d78-836c-bd98f2fbf2e3 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:08.909354 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4647f0ea-692a-4d78-836c-bd98f2fbf2e3 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:08.909775 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4647f0ea-692a-4d78-836c-bd98f2fbf2e3 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:09.018952 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-08e0a94c-a821-4882-b16d-5a7d0c27f27d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:09.019530 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-08e0a94c-a821-4882-b16d-5a7d0c27f27d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:09.026332 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-08e0a94c-a821-4882-b16d-5a7d0c27f27d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:09.026825 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-08e0a94c-a821-4882-b16d-5a7d0c27f27d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:09.027255 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-08e0a94c-a821-4882-b16d-5a7d0c27f27d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:09.027941 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-08e0a94c-a821-4882-b16d-5a7d0c27f27d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:09.028464 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-08e0a94c-a821-4882-b16d-5a7d0c27f27d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:09.028882 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-08e0a94c-a821-4882-b16d-5a7d0c27f27d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:09.046679 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-4647f0ea-692a-4d78-836c-bd98f2fbf2e3 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:09.054225 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-4647f0ea-692a-4d78-836c-bd98f2fbf2e3 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1568 microversion: 2.1 time: 0.162617 Sep 02 05:30:09.054794 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 402/803] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:08 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:09.160711 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-08e0a94c-a821-4882-b16d-5a7d0c27f27d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:09.169051 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-08e0a94c-a821-4882-b16d-5a7d0c27f27d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1737 microversion: 2.1 time: 0.153998 Sep 02 05:30:09.169613 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 402/804] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:09 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:10.079042 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-f5a4d074-5738-45b1-816e-ef61fc7f05cb tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:10.079809 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-f5a4d074-5738-45b1-816e-ef61fc7f05cb tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:10.088804 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f5a4d074-5738-45b1-816e-ef61fc7f05cb tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:10.089443 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f5a4d074-5738-45b1-816e-ef61fc7f05cb tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:10.090023 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f5a4d074-5738-45b1-816e-ef61fc7f05cb tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:10.090930 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f5a4d074-5738-45b1-816e-ef61fc7f05cb tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:10.091536 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f5a4d074-5738-45b1-816e-ef61fc7f05cb tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:10.092104 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f5a4d074-5738-45b1-816e-ef61fc7f05cb tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:10.190807 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f7f32be3-f4b8-4a7d-af5b-00b153f9e2ce tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:10.191448 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f7f32be3-f4b8-4a7d-af5b-00b153f9e2ce tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:10.198176 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f7f32be3-f4b8-4a7d-af5b-00b153f9e2ce tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:10.198722 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f7f32be3-f4b8-4a7d-af5b-00b153f9e2ce tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:10.199162 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f7f32be3-f4b8-4a7d-af5b-00b153f9e2ce tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:10.199869 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f7f32be3-f4b8-4a7d-af5b-00b153f9e2ce tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:10.200352 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f7f32be3-f4b8-4a7d-af5b-00b153f9e2ce tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:10.200809 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f7f32be3-f4b8-4a7d-af5b-00b153f9e2ce tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:10.244403 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-f5a4d074-5738-45b1-816e-ef61fc7f05cb tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:10.252700 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-f5a4d074-5738-45b1-816e-ef61fc7f05cb tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1568 microversion: 2.1 time: 0.179671 Sep 02 05:30:10.253255 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 403/805] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:10 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:10.344880 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f7f32be3-f4b8-4a7d-af5b-00b153f9e2ce tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:10.353490 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f7f32be3-f4b8-4a7d-af5b-00b153f9e2ce tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1737 microversion: 2.1 time: 0.166590 Sep 02 05:30:10.354056 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 403/806] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:10 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:11.277788 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-27f0849e-3d2e-4b47-a622-a863b9e5b8fe tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:11.278385 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-27f0849e-3d2e-4b47-a622-a863b9e5b8fe tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:11.288180 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-27f0849e-3d2e-4b47-a622-a863b9e5b8fe tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:11.288873 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-27f0849e-3d2e-4b47-a622-a863b9e5b8fe tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:11.289471 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-27f0849e-3d2e-4b47-a622-a863b9e5b8fe tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:11.290495 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-27f0849e-3d2e-4b47-a622-a863b9e5b8fe tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:11.291126 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-27f0849e-3d2e-4b47-a622-a863b9e5b8fe tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:11.291704 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-27f0849e-3d2e-4b47-a622-a863b9e5b8fe tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:11.382501 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-e57b5ffe-4d7e-4b8a-a569-59975709ce53 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:11.383206 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-e57b5ffe-4d7e-4b8a-a569-59975709ce53 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:11.389955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e57b5ffe-4d7e-4b8a-a569-59975709ce53 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:11.390490 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e57b5ffe-4d7e-4b8a-a569-59975709ce53 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:11.390924 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e57b5ffe-4d7e-4b8a-a569-59975709ce53 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:11.391676 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e57b5ffe-4d7e-4b8a-a569-59975709ce53 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:11.392154 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e57b5ffe-4d7e-4b8a-a569-59975709ce53 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:11.392593 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e57b5ffe-4d7e-4b8a-a569-59975709ce53 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:11.429850 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-27f0849e-3d2e-4b47-a622-a863b9e5b8fe tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:11.438627 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-27f0849e-3d2e-4b47-a622-a863b9e5b8fe tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1568 microversion: 2.1 time: 0.167173 Sep 02 05:30:11.439230 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 404/807] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:11 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:11.528636 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-e57b5ffe-4d7e-4b8a-a569-59975709ce53 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:11.542196 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-e57b5ffe-4d7e-4b8a-a569-59975709ce53 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1737 microversion: 2.1 time: 0.163399 Sep 02 05:30:11.542840 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 404/808] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:11 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:12.464357 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-317e4d3b-8acc-48ef-a13d-41fca8393750 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:12.465437 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-317e4d3b-8acc-48ef-a13d-41fca8393750 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:12.473316 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-317e4d3b-8acc-48ef-a13d-41fca8393750 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:12.473805 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-317e4d3b-8acc-48ef-a13d-41fca8393750 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:12.474239 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-317e4d3b-8acc-48ef-a13d-41fca8393750 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:12.474929 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-317e4d3b-8acc-48ef-a13d-41fca8393750 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:12.475385 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-317e4d3b-8acc-48ef-a13d-41fca8393750 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:12.475813 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-317e4d3b-8acc-48ef-a13d-41fca8393750 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:12.493888 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=100 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:30:12.563895 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-342e2a0e-c865-4aa5-a856-b32dbed5c8ed tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:12.564715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-342e2a0e-c865-4aa5-a856-b32dbed5c8ed tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:12.571407 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-342e2a0e-c865-4aa5-a856-b32dbed5c8ed tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:12.571894 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-342e2a0e-c865-4aa5-a856-b32dbed5c8ed tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:12.572358 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-342e2a0e-c865-4aa5-a856-b32dbed5c8ed tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:12.573045 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-342e2a0e-c865-4aa5-a856-b32dbed5c8ed tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:12.573499 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-342e2a0e-c865-4aa5-a856-b32dbed5c8ed tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:12.573920 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-342e2a0e-c865-4aa5-a856-b32dbed5c8ed tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:12.625004 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-317e4d3b-8acc-48ef-a13d-41fca8393750 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:12.633269 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-317e4d3b-8acc-48ef-a13d-41fca8393750 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1568 microversion: 2.1 time: 0.175649 Sep 02 05:30:12.633821 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 405/809] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:12 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:12.708153 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-342e2a0e-c865-4aa5-a856-b32dbed5c8ed tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:12.716828 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-342e2a0e-c865-4aa5-a856-b32dbed5c8ed tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1737 microversion: 2.1 time: 0.157043 Sep 02 05:30:12.717367 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 405/810] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:12 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:13.658785 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-aac5f806-6ec1-4362-9694-52021f629924 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:13.659797 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-aac5f806-6ec1-4362-9694-52021f629924 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:13.670945 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-aac5f806-6ec1-4362-9694-52021f629924 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:13.671816 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-aac5f806-6ec1-4362-9694-52021f629924 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:13.672278 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-aac5f806-6ec1-4362-9694-52021f629924 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:13.673001 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-aac5f806-6ec1-4362-9694-52021f629924 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:13.673445 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-aac5f806-6ec1-4362-9694-52021f629924 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:13.673852 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-aac5f806-6ec1-4362-9694-52021f629924 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:13.738034 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-7e8b0470-daa2-42e7-a2f2-f5b283ea6c6c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:13.738943 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-7e8b0470-daa2-42e7-a2f2-f5b283ea6c6c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:13.746288 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7e8b0470-daa2-42e7-a2f2-f5b283ea6c6c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:13.746766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7e8b0470-daa2-42e7-a2f2-f5b283ea6c6c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:13.747199 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7e8b0470-daa2-42e7-a2f2-f5b283ea6c6c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:13.747906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7e8b0470-daa2-42e7-a2f2-f5b283ea6c6c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:13.748556 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7e8b0470-daa2-42e7-a2f2-f5b283ea6c6c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:13.748994 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7e8b0470-daa2-42e7-a2f2-f5b283ea6c6c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:13.846313 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-aac5f806-6ec1-4362-9694-52021f629924 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:13.854268 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-aac5f806-6ec1-4362-9694-52021f629924 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1568 microversion: 2.1 time: 0.202053 Sep 02 05:30:13.854844 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 406/811] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:13 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1568 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:13.909557 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-7e8b0470-daa2-42e7-a2f2-f5b283ea6c6c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:13.917832 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-7e8b0470-daa2-42e7-a2f2-f5b283ea6c6c tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1717 microversion: 2.1 time: 0.183908 Sep 02 05:30:13.918393 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 406/812] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:13 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1717 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:13.980138 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5d39b7ce-d144-4ff4-9d60-af19621b08ef tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:13.980628 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5d39b7ce-d144-4ff4-9d60-af19621b08ef tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:13.986992 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5d39b7ce-d144-4ff4-9d60-af19621b08ef tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:13.987462 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5d39b7ce-d144-4ff4-9d60-af19621b08ef tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:13.987915 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5d39b7ce-d144-4ff4-9d60-af19621b08ef tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:13.988965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5d39b7ce-d144-4ff4-9d60-af19621b08ef tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:13.989389 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5d39b7ce-d144-4ff4-9d60-af19621b08ef tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:13.989822 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5d39b7ce-d144-4ff4-9d60-af19621b08ef tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:14.075551 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.wsgi [None req-5d39b7ce-d144-4ff4-9d60-af19621b08ef tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] HTTP exception thrown: Cannot 'detach_volume' instance dc1683c4-1646-485d-99de-4b1591af0455 while it is in vm_state rescued Sep 02 05:30:14.078177 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5d39b7ce-d144-4ff4-9d60-af19621b08ef tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Request method failure captured: Sep 02 05:30:14.078177 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: request: DELETE /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455/os-volume_attachments/3f0274e3-5836-4d94-b281-31268626f7da HTTP/1.1 Sep 02 05:30:14.078177 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept: application/json Sep 02 05:30:14.078177 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept-Encoding: identity Sep 02 05:30:14.078177 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Connection: close Sep 02 05:30:14.078177 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Length: 0 Sep 02 05:30:14.078177 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Type: application/json Sep 02 05:30:14.078177 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Host: 10.222.0.30 Sep 02 05:30:14.078177 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Openstack-System-Scope: None Sep 02 05:30:14.078177 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: User-Agent: python-urllib3/1.26.12 Sep 02 05:30:14.078177 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Auth-Token: gAAAAABjEZNBlGshjFXTj3Lb-EsC2OrvCSUzgDqiBOUbh8k6e0DYXEDuZx7d2X75THMEeewYJFzTyJmM3mcIGQBFVZgGuF590inOhOXA9tdLJRxjl4ttomYD3QOlAB_biUP2CACfOsx1otZIYpC4WWkCXsXkROF6dcYM2y0smQkEpR6j2BEgLD0 Sep 02 05:30:14.078177 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Id: None Sep 02 05:30:14.078177 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Name: None Sep 02 05:30:14.078177 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Identity-Status: Confirmed Sep 02 05:30:14.078177 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Is-Admin-Project: True Sep 02 05:30:14.078177 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Id: default Sep 02 05:30:14.078177 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Name: Default Sep 02 05:30:14.078177 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Id: 8eb15e49aead4c2987f1ac32180db505 Sep 02 05:30:14.078177 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1496035544 Sep 02 05:30:14.078177 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Role: member,reader Sep 02 05:30:14.078177 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Roles: member,reader Sep 02 05:30:14.079698 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8eb15e49aead4c2987f1ac32180db505"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8eb15e49aead4c2987f1ac32180db505"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8eb15e49aead4c2987f1ac32180db505"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8eb15e49aead4c2987f1ac32180db505"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:30:14.079698 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1496035544 Sep 02 05:30:14.079698 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Id: 8eb15e49aead4c2987f1ac32180db505 Sep 02 05:30:14.079698 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1496035544 Sep 02 05:30:14.079698 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User: tempest-ServerRescueNegativeTestJSON-1496035544-project Sep 02 05:30:14.079698 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Id: default Sep 02 05:30:14.079698 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Name: Default Sep 02 05:30:14.079698 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Id: d27e9069d6c4406292c48ea81b2bc78a Sep 02 05:30:14.079698 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1496035544-project Sep 02 05:30:14.079698 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: method: > Sep 02 05:30:14.079698 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: exception: Cannot 'detach_volume' instance dc1683c4-1646-485d-99de-4b1591af0455 while it is in vm_state rescued Sep 02 05:30:14.080474 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: action_args: {'server_id': 'dc1683c4-1646-485d-99de-4b1591af0455', 'id': '3f0274e3-5836-4d94-b281-31268626f7da'} Sep 02 05:30:14.080474 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:30:14.080474 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:30:14.080474 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 02 05:30:14.080474 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 02 05:30:14.080474 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 05:30:14.080474 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 05:30:14.080474 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 02 05:30:14.080474 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 02 05:30:14.080474 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dc1683c4-1646-485d-99de-4b1591af0455 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 02 05:30:14.080474 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:30:14.080474 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:30:14.080474 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:30:14.080474 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:30:14.080474 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:30:14.080474 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:30:14.080474 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:30:14.080474 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:30:14.080474 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:30:14.080474 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:30:14.081769 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 02 05:30:14.081769 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 02 05:30:14.081769 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 02 05:30:14.081769 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 02 05:30:14.081769 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance dc1683c4-1646-485d-99de-4b1591af0455 while it is in vm_state rescued Sep 02 05:30:14.081769 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:30:14.081769 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:30:14.081769 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:30:14.081769 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:30:14.081769 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:30:14.081769 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:30:14.081769 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:30:14.081769 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:30:14.081769 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance dc1683c4-1646-485d-99de-4b1591af0455 while it is in vm_state rescued Sep 02 05:30:14.081769 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:30:14.081769 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5d39b7ce-d144-4ff4-9d60-af19621b08ef tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Returning 409 to user: Cannot 'detach_volume' instance dc1683c4-1646-485d-99de-4b1591af0455 while it is in vm_state rescued {{(pid=120449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:30:14.082792 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5d39b7ce-d144-4ff4-9d60-af19621b08ef tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455/os-volume_attachments/3f0274e3-5836-4d94-b281-31268626f7da" status: 409 len: 152 microversion: 2.1 time: 0.103563 Sep 02 05:30:14.082792 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 407/813] 10.222.0.30 () {58 vars in 1416 bytes} [Fri Sep 2 05:30:13 2022] DELETE /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455/os-volume_attachments/3f0274e3-5836-4d94-b281-31268626f7da => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 02 05:30:14.091562 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-c7a0d7fe-61a1-4110-938c-4a793191cad2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:30:14.092444 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-c7a0d7fe-61a1-4110-938c-4a793191cad2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:14.099284 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c7a0d7fe-61a1-4110-938c-4a793191cad2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:14.099768 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c7a0d7fe-61a1-4110-938c-4a793191cad2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:14.100243 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c7a0d7fe-61a1-4110-938c-4a793191cad2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:14.100938 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c7a0d7fe-61a1-4110-938c-4a793191cad2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:14.101394 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c7a0d7fe-61a1-4110-938c-4a793191cad2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:14.101816 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c7a0d7fe-61a1-4110-938c-4a793191cad2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:14.172780 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-c7a0d7fe-61a1-4110-938c-4a793191cad2 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "POST /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455/action" status: 202 len: 0 microversion: 2.1 time: 0.087143 Sep 02 05:30:14.173361 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 407/814] 10.222.0.30 () {60 vars in 1278 bytes} [Fri Sep 2 05:30:14 2022] POST /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:30:14.181670 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-e207ad44-bb2c-4dde-8241-1fb033cabb44 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:14.182323 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-e207ad44-bb2c-4dde-8241-1fb033cabb44 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:14.190121 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e207ad44-bb2c-4dde-8241-1fb033cabb44 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:14.190602 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e207ad44-bb2c-4dde-8241-1fb033cabb44 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:14.191033 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e207ad44-bb2c-4dde-8241-1fb033cabb44 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:14.191758 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e207ad44-bb2c-4dde-8241-1fb033cabb44 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:14.192221 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e207ad44-bb2c-4dde-8241-1fb033cabb44 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:14.192643 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e207ad44-bb2c-4dde-8241-1fb033cabb44 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:14.409611 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e207ad44-bb2c-4dde-8241-1fb033cabb44 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:14.418902 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-e207ad44-bb2c-4dde-8241-1fb033cabb44 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1725 microversion: 2.1 time: 0.241041 Sep 02 05:30:14.419486 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 408/815] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:14 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1725 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:14.876997 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-44940bc2-1a0f-4ce1-9f42-2e9db9aa7364 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:14.877709 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-44940bc2-1a0f-4ce1-9f42-2e9db9aa7364 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:14.883937 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-44940bc2-1a0f-4ce1-9f42-2e9db9aa7364 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:14.884446 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-44940bc2-1a0f-4ce1-9f42-2e9db9aa7364 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:14.884876 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-44940bc2-1a0f-4ce1-9f42-2e9db9aa7364 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:14.885558 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-44940bc2-1a0f-4ce1-9f42-2e9db9aa7364 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:14.885999 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-44940bc2-1a0f-4ce1-9f42-2e9db9aa7364 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:14.886439 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-44940bc2-1a0f-4ce1-9f42-2e9db9aa7364 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:15.085651 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-44940bc2-1a0f-4ce1-9f42-2e9db9aa7364 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:15.094162 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-44940bc2-1a0f-4ce1-9f42-2e9db9aa7364 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1568 microversion: 2.1 time: 0.221977 Sep 02 05:30:15.104167 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 408/816] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:14 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:15.442835 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-30648448-d65c-403c-9d39-1d605ee29ae0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:15.443459 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-30648448-d65c-403c-9d39-1d605ee29ae0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:15.450718 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-30648448-d65c-403c-9d39-1d605ee29ae0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:15.451202 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-30648448-d65c-403c-9d39-1d605ee29ae0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:15.451645 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-30648448-d65c-403c-9d39-1d605ee29ae0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:15.452397 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-30648448-d65c-403c-9d39-1d605ee29ae0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:15.452858 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-30648448-d65c-403c-9d39-1d605ee29ae0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:15.453281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-30648448-d65c-403c-9d39-1d605ee29ae0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:15.583162 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-30648448-d65c-403c-9d39-1d605ee29ae0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:15.591548 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-30648448-d65c-403c-9d39-1d605ee29ae0 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1725 microversion: 2.1 time: 0.153474 Sep 02 05:30:15.592110 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 409/817] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:15 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:16.119290 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d72e4d74-844f-408e-ad6e-99e12279fa80 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:16.120182 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-d72e4d74-844f-408e-ad6e-99e12279fa80 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:16.128727 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d72e4d74-844f-408e-ad6e-99e12279fa80 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:16.129213 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d72e4d74-844f-408e-ad6e-99e12279fa80 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:16.129650 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d72e4d74-844f-408e-ad6e-99e12279fa80 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:16.130342 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d72e4d74-844f-408e-ad6e-99e12279fa80 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:16.130801 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d72e4d74-844f-408e-ad6e-99e12279fa80 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:16.131221 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d72e4d74-844f-408e-ad6e-99e12279fa80 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:16.434543 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d72e4d74-844f-408e-ad6e-99e12279fa80 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:16.445325 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-d72e4d74-844f-408e-ad6e-99e12279fa80 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1568 microversion: 2.1 time: 0.332913 Sep 02 05:30:16.445928 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 409/818] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:16 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1568 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:16.614531 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-3e5accb1-6673-4276-afe6-26d896b087d9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:16.615356 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-3e5accb1-6673-4276-afe6-26d896b087d9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:16.625210 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3e5accb1-6673-4276-afe6-26d896b087d9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:16.625802 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3e5accb1-6673-4276-afe6-26d896b087d9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:16.626438 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3e5accb1-6673-4276-afe6-26d896b087d9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:16.627419 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3e5accb1-6673-4276-afe6-26d896b087d9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:16.628073 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3e5accb1-6673-4276-afe6-26d896b087d9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:16.628740 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3e5accb1-6673-4276-afe6-26d896b087d9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:16.768035 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-3e5accb1-6673-4276-afe6-26d896b087d9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:16.776955 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-3e5accb1-6673-4276-afe6-26d896b087d9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1725 microversion: 2.1 time: 0.168048 Sep 02 05:30:16.777534 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 410/819] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:16 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:17.474655 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-246f511b-89ca-4b9b-8646-11a6371f805b tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:17.475621 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-246f511b-89ca-4b9b-8646-11a6371f805b tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:17.485999 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-246f511b-89ca-4b9b-8646-11a6371f805b tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:17.486486 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-246f511b-89ca-4b9b-8646-11a6371f805b tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:17.486923 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-246f511b-89ca-4b9b-8646-11a6371f805b tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:17.487659 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-246f511b-89ca-4b9b-8646-11a6371f805b tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:17.488104 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-246f511b-89ca-4b9b-8646-11a6371f805b tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:17.488883 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-246f511b-89ca-4b9b-8646-11a6371f805b tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:17.637950 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-246f511b-89ca-4b9b-8646-11a6371f805b tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:17.649344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-246f511b-89ca-4b9b-8646-11a6371f805b tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1568 microversion: 2.1 time: 0.181120 Sep 02 05:30:17.650208 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 410/820] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:17 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:17.802258 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-81b6bd62-0d24-46c7-abe0-f58354e106e1 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:17.803269 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-81b6bd62-0d24-46c7-abe0-f58354e106e1 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:17.813658 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-81b6bd62-0d24-46c7-abe0-f58354e106e1 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:17.814138 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-81b6bd62-0d24-46c7-abe0-f58354e106e1 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:17.814578 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-81b6bd62-0d24-46c7-abe0-f58354e106e1 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:17.815269 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-81b6bd62-0d24-46c7-abe0-f58354e106e1 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:17.815722 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-81b6bd62-0d24-46c7-abe0-f58354e106e1 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:17.816164 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-81b6bd62-0d24-46c7-abe0-f58354e106e1 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:17.950679 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-81b6bd62-0d24-46c7-abe0-f58354e106e1 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:17.959773 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-81b6bd62-0d24-46c7-abe0-f58354e106e1 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1725 microversion: 2.1 time: 0.163930 Sep 02 05:30:17.960395 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 411/821] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:17 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:18.675638 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-2ab5ecf0-87a3-4b9a-af8a-51995a816f40 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:18.676290 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-2ab5ecf0-87a3-4b9a-af8a-51995a816f40 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:18.683401 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2ab5ecf0-87a3-4b9a-af8a-51995a816f40 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:18.683891 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2ab5ecf0-87a3-4b9a-af8a-51995a816f40 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:18.684354 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2ab5ecf0-87a3-4b9a-af8a-51995a816f40 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:18.685071 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2ab5ecf0-87a3-4b9a-af8a-51995a816f40 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:18.685517 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2ab5ecf0-87a3-4b9a-af8a-51995a816f40 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:18.685938 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2ab5ecf0-87a3-4b9a-af8a-51995a816f40 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:18.823924 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-2ab5ecf0-87a3-4b9a-af8a-51995a816f40 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:18.832948 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-2ab5ecf0-87a3-4b9a-af8a-51995a816f40 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1568 microversion: 2.1 time: 0.161997 Sep 02 05:30:18.833757 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 411/822] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:18 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:18.985491 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-51b0bb09-1374-4a92-ae4e-4e8c636f270d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:18.986045 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-51b0bb09-1374-4a92-ae4e-4e8c636f270d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:18.993051 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-51b0bb09-1374-4a92-ae4e-4e8c636f270d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:18.993539 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-51b0bb09-1374-4a92-ae4e-4e8c636f270d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:18.993969 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-51b0bb09-1374-4a92-ae4e-4e8c636f270d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:18.994667 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-51b0bb09-1374-4a92-ae4e-4e8c636f270d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:18.995119 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-51b0bb09-1374-4a92-ae4e-4e8c636f270d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:18.995531 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-51b0bb09-1374-4a92-ae4e-4e8c636f270d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:19.133350 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-51b0bb09-1374-4a92-ae4e-4e8c636f270d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:19.141845 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-51b0bb09-1374-4a92-ae4e-4e8c636f270d tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1725 microversion: 2.1 time: 0.162580 Sep 02 05:30:19.142422 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 412/823] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:18 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:19.858878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-9e7a678a-3cb4-4ec4-a3c2-d982784d5c3e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:19.859994 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-9e7a678a-3cb4-4ec4-a3c2-d982784d5c3e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:19.871411 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9e7a678a-3cb4-4ec4-a3c2-d982784d5c3e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:19.872276 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9e7a678a-3cb4-4ec4-a3c2-d982784d5c3e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:19.872988 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9e7a678a-3cb4-4ec4-a3c2-d982784d5c3e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:19.874143 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9e7a678a-3cb4-4ec4-a3c2-d982784d5c3e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:19.874891 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9e7a678a-3cb4-4ec4-a3c2-d982784d5c3e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:19.875569 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9e7a678a-3cb4-4ec4-a3c2-d982784d5c3e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:20.007616 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-9e7a678a-3cb4-4ec4-a3c2-d982784d5c3e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:20.016673 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-9e7a678a-3cb4-4ec4-a3c2-d982784d5c3e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1568 microversion: 2.1 time: 0.164228 Sep 02 05:30:20.017623 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 412/824] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:19 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:20.163485 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-cd2dafbc-acee-483b-b771-c613c372d3df tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:20.164146 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-cd2dafbc-acee-483b-b771-c613c372d3df tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:20.170771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cd2dafbc-acee-483b-b771-c613c372d3df tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:20.171725 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cd2dafbc-acee-483b-b771-c613c372d3df tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:20.171725 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cd2dafbc-acee-483b-b771-c613c372d3df tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:20.172711 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cd2dafbc-acee-483b-b771-c613c372d3df tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:20.173178 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cd2dafbc-acee-483b-b771-c613c372d3df tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:20.173595 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cd2dafbc-acee-483b-b771-c613c372d3df tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:20.388716 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-cd2dafbc-acee-483b-b771-c613c372d3df tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:20.397572 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-cd2dafbc-acee-483b-b771-c613c372d3df tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1731 microversion: 2.1 time: 0.238280 Sep 02 05:30:20.412144 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 413/825] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:20 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1731 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:20.418235 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-64e21f27-8f78-4338-9dd3-a29a51602612 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:20.418718 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-64e21f27-8f78-4338-9dd3-a29a51602612 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:20.425471 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-64e21f27-8f78-4338-9dd3-a29a51602612 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:20.425931 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-64e21f27-8f78-4338-9dd3-a29a51602612 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:20.426391 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-64e21f27-8f78-4338-9dd3-a29a51602612 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:20.427082 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-64e21f27-8f78-4338-9dd3-a29a51602612 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:20.427532 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-64e21f27-8f78-4338-9dd3-a29a51602612 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:20.427942 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-64e21f27-8f78-4338-9dd3-a29a51602612 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:20.522043 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-64e21f27-8f78-4338-9dd3-a29a51602612 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107641 Sep 02 05:30:20.522637 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 413/826] 10.222.0.30 () {58 vars in 1275 bytes} [Fri Sep 2 05:30:20 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:30:20.707014 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-6b485bc4-9dff-4175-8840-bc531d597ea6 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:20.707506 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-6b485bc4-9dff-4175-8840-bc531d597ea6 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:20.714185 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6b485bc4-9dff-4175-8840-bc531d597ea6 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:20.714185 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6b485bc4-9dff-4175-8840-bc531d597ea6 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:20.714562 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6b485bc4-9dff-4175-8840-bc531d597ea6 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:20.715243 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6b485bc4-9dff-4175-8840-bc531d597ea6 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:20.715679 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6b485bc4-9dff-4175-8840-bc531d597ea6 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:20.716084 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6b485bc4-9dff-4175-8840-bc531d597ea6 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:20.742725 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-6b485bc4-9dff-4175-8840-bc531d597ea6 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a/ips" status: 200 len: 149 microversion: 2.1 time: 0.151543 Sep 02 05:30:20.743215 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 414/827] 10.222.0.30 () {58 vars in 1248 bytes} [Fri Sep 2 05:30:20 2022] GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a/ips => generated 149 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:30:20.754727 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-30a0aac5-6d9f-4aca-adf7-9c9196302452 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb70b01f-a826-47f2-a333-ea50559bdc18"}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:30:20.757182 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-30a0aac5-6d9f-4aca-adf7-9c9196302452 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:20.763511 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-30a0aac5-6d9f-4aca-adf7-9c9196302452 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:20.763993 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-30a0aac5-6d9f-4aca-adf7-9c9196302452 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:20.764454 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-30a0aac5-6d9f-4aca-adf7-9c9196302452 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:20.765150 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-30a0aac5-6d9f-4aca-adf7-9c9196302452 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:20.765617 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-30a0aac5-6d9f-4aca-adf7-9c9196302452 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:20.766016 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-30a0aac5-6d9f-4aca-adf7-9c9196302452 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:20.770510 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:30:20.854832 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.wsgi [None req-30a0aac5-6d9f-4aca-adf7-9c9196302452 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] HTTP exception thrown: Invalid volume: volume cb70b01f-a826-47f2-a333-ea50559bdc18 is already attached to instances: 6ecefc31-2d93-4601-91e7-0d18da502d8b Sep 02 05:30:20.856771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-30a0aac5-6d9f-4aca-adf7-9c9196302452 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Request method failure captured: Sep 02 05:30:20.856771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: request: POST /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a/os-volume_attachments HTTP/1.1 Sep 02 05:30:20.856771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept: application/json Sep 02 05:30:20.856771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept-Encoding: identity Sep 02 05:30:20.856771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Connection: close Sep 02 05:30:20.856771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Length: 74 Sep 02 05:30:20.856771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Type: application/json Sep 02 05:30:20.856771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Host: 10.222.0.30 Sep 02 05:30:20.856771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Openstack-System-Scope: None Sep 02 05:30:20.856771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: User-Agent: python-urllib3/1.26.12 Sep 02 05:30:20.856771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Auth-Token: gAAAAABjEZM9sMpwUr9qoyGfMjDaBJ8P6YvBPQ-f9EMy1v-mwCEwm2r_bgyQO13MJw9PzuA9JX3XTWqubrdQgU1a6BCBynzOqQh_kSQW7GnBay9PYEuOinJQJVybarMVc5DymGEpqCE1wXufVXEiHhxifOsWWijBJ0RmMiTE9rG9XyLkwahJIcQ Sep 02 05:30:20.856771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Id: None Sep 02 05:30:20.856771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Name: None Sep 02 05:30:20.856771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Identity-Status: Confirmed Sep 02 05:30:20.856771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Is-Admin-Project: True Sep 02 05:30:20.856771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Id: default Sep 02 05:30:20.856771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Name: Default Sep 02 05:30:20.856771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Id: 0847ca942df54b659e8723463ab72c65 Sep 02 05:30:20.856771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Name: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:30:20.856771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Role: member,reader Sep 02 05:30:20.856771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Roles: member,reader Sep 02 05:30:20.858110 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0847ca942df54b659e8723463ab72c65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0847ca942df54b659e8723463ab72c65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0847ca942df54b659e8723463ab72c65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0847ca942df54b659e8723463ab72c65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:30:20.858110 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:30:20.858110 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Id: 0847ca942df54b659e8723463ab72c65 Sep 02 05:30:20.858110 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:30:20.858110 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User: tempest-AttachVolumeNegativeTest-1685577678-project Sep 02 05:30:20.858110 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Id: default Sep 02 05:30:20.858110 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Name: Default Sep 02 05:30:20.858110 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Id: ee1a3027b52f4b46bc5cff18f9cd0b02 Sep 02 05:30:20.858110 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Name: tempest-AttachVolumeNegativeTest-1685577678-project Sep 02 05:30:20.858110 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Sep 02 05:30:20.858110 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {"volumeAttachment": {"volumeId": "cb70b01f-a826-47f2-a333-ea50559bdc18"}} Sep 02 05:30:20.858110 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: method: > Sep 02 05:30:20.858927 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: exception: Invalid volume: volume cb70b01f-a826-47f2-a333-ea50559bdc18 is already attached to instances: 6ecefc31-2d93-4601-91e7-0d18da502d8b Sep 02 05:30:20.858927 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: action_args: {'server_id': 'e74e8e64-b53c-431b-bb9c-34e58ee81d9a', 'body': {'volumeAttachment': {'volumeId': 'cb70b01f-a826-47f2-a333-ea50559bdc18'}}} Sep 02 05:30:20.858927 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:30:20.858927 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:30:20.858927 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 02 05:30:20.858927 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 02 05:30:20.858927 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 05:30:20.858927 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 05:30:20.858927 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 02 05:30:20.858927 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 02 05:30:20.858927 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 02 05:30:20.858927 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 02 05:30:20.858927 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 02 05:30:20.858927 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 02 05:30:20.858927 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cb70b01f-a826-47f2-a333-ea50559bdc18 is already attached to instances: 6ecefc31-2d93-4601-91e7-0d18da502d8b Sep 02 05:30:20.858927 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:30:20.858927 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:30:20.858927 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:30:20.858927 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:30:20.860824 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:30:20.860824 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:30:20.860824 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:30:20.860824 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:30:20.860824 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:30:20.860824 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:30:20.860824 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 05:30:20.860824 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 05:30:20.860824 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 05:30:20.860824 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 05:30:20.860824 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 05:30:20.860824 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 05:30:20.860824 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 02 05:30:20.860824 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 02 05:30:20.860824 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cb70b01f-a826-47f2-a333-ea50559bdc18 is already attached to instances: 6ecefc31-2d93-4601-91e7-0d18da502d8b Sep 02 05:30:20.860824 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:30:20.860824 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:30:20.860824 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:30:20.860824 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:30:20.860824 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:30:20.862005 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:30:20.862005 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:30:20.862005 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:30:20.862005 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cb70b01f-a826-47f2-a333-ea50559bdc18 is already attached to instances: 6ecefc31-2d93-4601-91e7-0d18da502d8b Sep 02 05:30:20.862005 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:30:20.862005 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-30a0aac5-6d9f-4aca-adf7-9c9196302452 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Returning 400 to user: Invalid volume: volume cb70b01f-a826-47f2-a333-ea50559bdc18 is already attached to instances: 6ecefc31-2d93-4601-91e7-0d18da502d8b {{(pid=120448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:30:20.862005 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-30a0aac5-6d9f-4aca-adf7-9c9196302452 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "POST /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107709 Sep 02 05:30:20.862005 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 414/828] 10.222.0.30 () {60 vars in 1323 bytes} [Fri Sep 2 05:30:20 2022] POST /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 05:30:20.868072 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-91549b0b-7362-44f4-a631-2c7231f9c97c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:20.868660 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-91549b0b-7362-44f4-a631-2c7231f9c97c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:20.874749 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-91549b0b-7362-44f4-a631-2c7231f9c97c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:20.875329 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-91549b0b-7362-44f4-a631-2c7231f9c97c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:20.875758 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-91549b0b-7362-44f4-a631-2c7231f9c97c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:20.876462 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-91549b0b-7362-44f4-a631-2c7231f9c97c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:20.876909 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-91549b0b-7362-44f4-a631-2c7231f9c97c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:20.877358 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-91549b0b-7362-44f4-a631-2c7231f9c97c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:20.902181 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-91549b0b-7362-44f4-a631-2c7231f9c97c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Going to try to terminate instance {{(pid=120449) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 05:30:20.979023 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-91549b0b-7362-44f4-a631-2c7231f9c97c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a" status: 204 len: 0 microversion: 2.1 time: 0.114547 Sep 02 05:30:20.979605 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 415/829] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Sep 2 05:30:20 2022] DELETE /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 05:30:20.987923 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-c20762fc-f7f2-4a8c-9e5a-1d6a6cf763e5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:20.988878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-c20762fc-f7f2-4a8c-9e5a-1d6a6cf763e5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:20.996024 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c20762fc-f7f2-4a8c-9e5a-1d6a6cf763e5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:20.996473 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c20762fc-f7f2-4a8c-9e5a-1d6a6cf763e5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:20.996907 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c20762fc-f7f2-4a8c-9e5a-1d6a6cf763e5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:20.997602 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c20762fc-f7f2-4a8c-9e5a-1d6a6cf763e5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:20.998056 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c20762fc-f7f2-4a8c-9e5a-1d6a6cf763e5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:20.998479 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c20762fc-f7f2-4a8c-9e5a-1d6a6cf763e5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:21.038680 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-29baf964-46b5-4d4f-8432-4bf4ba1ba2df tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:21.039434 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-29baf964-46b5-4d4f-8432-4bf4ba1ba2df tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:21.045660 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-29baf964-46b5-4d4f-8432-4bf4ba1ba2df tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:21.046172 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-29baf964-46b5-4d4f-8432-4bf4ba1ba2df tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:21.046590 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-29baf964-46b5-4d4f-8432-4bf4ba1ba2df tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:21.047407 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-29baf964-46b5-4d4f-8432-4bf4ba1ba2df tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:21.048066 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-29baf964-46b5-4d4f-8432-4bf4ba1ba2df tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:21.048596 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-29baf964-46b5-4d4f-8432-4bf4ba1ba2df tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:21.188060 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c20762fc-f7f2-4a8c-9e5a-1d6a6cf763e5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:21.196015 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-c20762fc-f7f2-4a8c-9e5a-1d6a6cf763e5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a" status: 200 len: 1680 microversion: 2.1 time: 0.211984 Sep 02 05:30:21.196651 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 415/830] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:20 2022] GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a => generated 1680 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:30:21.225512 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-29baf964-46b5-4d4f-8432-4bf4ba1ba2df tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:21.236042 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-29baf964-46b5-4d4f-8432-4bf4ba1ba2df tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1568 microversion: 2.1 time: 0.201824 Sep 02 05:30:21.236647 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 416/831] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:21 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1568 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:21.419450 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-aeb3cbfe-1ad3-4ed7-93b3-d152d7ac68f1 req-896530d6-4c22-4b6f-9cc7-5b58d65c31ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc1683c4-1646-485d-99de-4b1591af0455", "tag": "9b093d1d-f4c7-44e9-a59c-36fc5dbe9a0a"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:30:21.429718 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-aeb3cbfe-1ad3-4ed7-93b3-d152d7ac68f1 req-896530d6-4c22-4b6f-9cc7-5b58d65c31ae service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:21.430493 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-aeb3cbfe-1ad3-4ed7-93b3-d152d7ac68f1 req-896530d6-4c22-4b6f-9cc7-5b58d65c31ae service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:21.431173 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-aeb3cbfe-1ad3-4ed7-93b3-d152d7ac68f1 req-896530d6-4c22-4b6f-9cc7-5b58d65c31ae service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:21.445225 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-aeb3cbfe-1ad3-4ed7-93b3-d152d7ac68f1 req-896530d6-4c22-4b6f-9cc7-5b58d65c31ae service nova] Creating event network-changed:9b093d1d-f4c7-44e9-a59c-36fc5dbe9a0a for instance dc1683c4-1646-485d-99de-4b1591af0455 on hv-cinder-85391 Sep 02 05:30:21.450039 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-aeb3cbfe-1ad3-4ed7-93b3-d152d7ac68f1 req-896530d6-4c22-4b6f-9cc7-5b58d65c31ae service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034432 Sep 02 05:30:21.450628 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 416/832] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:30:22.222718 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-d6be3900-26d4-45b6-b4ad-c25bbd8ad9b7 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:22.223197 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-d6be3900-26d4-45b6-b4ad-c25bbd8ad9b7 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:22.230237 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d6be3900-26d4-45b6-b4ad-c25bbd8ad9b7 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:22.231083 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d6be3900-26d4-45b6-b4ad-c25bbd8ad9b7 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:22.231289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d6be3900-26d4-45b6-b4ad-c25bbd8ad9b7 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:22.232345 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d6be3900-26d4-45b6-b4ad-c25bbd8ad9b7 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:22.232925 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d6be3900-26d4-45b6-b4ad-c25bbd8ad9b7 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:22.233562 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d6be3900-26d4-45b6-b4ad-c25bbd8ad9b7 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:22.258638 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-9cd7e283-c3e9-46ab-93e6-3717ae632259 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:22.259336 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-9cd7e283-c3e9-46ab-93e6-3717ae632259 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:22.265855 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9cd7e283-c3e9-46ab-93e6-3717ae632259 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:22.266334 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9cd7e283-c3e9-46ab-93e6-3717ae632259 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:22.266791 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9cd7e283-c3e9-46ab-93e6-3717ae632259 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:22.267554 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9cd7e283-c3e9-46ab-93e6-3717ae632259 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:22.268030 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9cd7e283-c3e9-46ab-93e6-3717ae632259 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:22.268470 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9cd7e283-c3e9-46ab-93e6-3717ae632259 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:22.671222 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-d6be3900-26d4-45b6-b4ad-c25bbd8ad9b7 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:22.679607 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-d6be3900-26d4-45b6-b4ad-c25bbd8ad9b7 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a" status: 200 len: 1680 microversion: 2.1 time: 0.461021 Sep 02 05:30:22.680178 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 417/833] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:22 2022] GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a => generated 1680 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:22.684858 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-9cd7e283-c3e9-46ab-93e6-3717ae632259 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:22.692785 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-9cd7e283-c3e9-46ab-93e6-3717ae632259 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1568 microversion: 2.1 time: 0.438749 Sep 02 05:30:22.693342 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 417/834] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:22 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1568 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:23.467510 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-53bad31e-1644-4916-9401-6460b5dc419d req-62ba8c6c-a007-48cb-b5b7-00980b1f36f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc1683c4-1646-485d-99de-4b1591af0455", "tag": "9b093d1d-f4c7-44e9-a59c-36fc5dbe9a0a"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:30:23.478348 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-53bad31e-1644-4916-9401-6460b5dc419d req-62ba8c6c-a007-48cb-b5b7-00980b1f36f2 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:23.478832 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-53bad31e-1644-4916-9401-6460b5dc419d req-62ba8c6c-a007-48cb-b5b7-00980b1f36f2 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:23.479256 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-53bad31e-1644-4916-9401-6460b5dc419d req-62ba8c6c-a007-48cb-b5b7-00980b1f36f2 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:23.492709 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-53bad31e-1644-4916-9401-6460b5dc419d req-62ba8c6c-a007-48cb-b5b7-00980b1f36f2 service nova] Creating event network-changed:9b093d1d-f4c7-44e9-a59c-36fc5dbe9a0a for instance dc1683c4-1646-485d-99de-4b1591af0455 on hv-cinder-85391 Sep 02 05:30:23.497709 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-53bad31e-1644-4916-9401-6460b5dc419d req-62ba8c6c-a007-48cb-b5b7-00980b1f36f2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035915 Sep 02 05:30:23.498271 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 418/835] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:30:23.701644 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-60bf5ed0-e91b-45a3-a71c-006a4c4dd81e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:23.702800 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-60bf5ed0-e91b-45a3-a71c-006a4c4dd81e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:23.709950 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-60bf5ed0-e91b-45a3-a71c-006a4c4dd81e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:23.710385 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-60bf5ed0-e91b-45a3-a71c-006a4c4dd81e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:23.710823 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-60bf5ed0-e91b-45a3-a71c-006a4c4dd81e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:23.711527 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-60bf5ed0-e91b-45a3-a71c-006a4c4dd81e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:23.711976 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-60bf5ed0-e91b-45a3-a71c-006a4c4dd81e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:23.712583 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-60bf5ed0-e91b-45a3-a71c-006a4c4dd81e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:23.715419 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-a8f78337-0c89-47b8-90c3-0e0384092990 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:23.716263 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-a8f78337-0c89-47b8-90c3-0e0384092990 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:23.725934 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a8f78337-0c89-47b8-90c3-0e0384092990 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:23.726423 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a8f78337-0c89-47b8-90c3-0e0384092990 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:23.726863 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a8f78337-0c89-47b8-90c3-0e0384092990 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:23.727563 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a8f78337-0c89-47b8-90c3-0e0384092990 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:23.728018 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a8f78337-0c89-47b8-90c3-0e0384092990 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:23.728486 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a8f78337-0c89-47b8-90c3-0e0384092990 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:23.919241 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-60bf5ed0-e91b-45a3-a71c-006a4c4dd81e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:23.924538 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-a8f78337-0c89-47b8-90c3-0e0384092990 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:23.927828 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-60bf5ed0-e91b-45a3-a71c-006a4c4dd81e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a" status: 200 len: 1680 microversion: 2.1 time: 0.230296 Sep 02 05:30:23.928557 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 418/836] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:23 2022] GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a => generated 1680 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:23.933282 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-a8f78337-0c89-47b8-90c3-0e0384092990 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1568 microversion: 2.1 time: 0.222579 Sep 02 05:30:23.933876 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 419/837] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:23 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:24.958948 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-2e0405b2-542c-496f-a772-088c5ece0166 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:24.960068 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-a86ba9bb-65b8-49f8-a506-862522706cdd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:24.961429 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-2e0405b2-542c-496f-a772-088c5ece0166 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:24.961940 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-a86ba9bb-65b8-49f8-a506-862522706cdd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:24.973106 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2e0405b2-542c-496f-a772-088c5ece0166 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:24.977848 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a86ba9bb-65b8-49f8-a506-862522706cdd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:24.978427 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a86ba9bb-65b8-49f8-a506-862522706cdd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:24.978886 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2e0405b2-542c-496f-a772-088c5ece0166 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:24.979392 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a86ba9bb-65b8-49f8-a506-862522706cdd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:24.980165 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2e0405b2-542c-496f-a772-088c5ece0166 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:24.982852 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2e0405b2-542c-496f-a772-088c5ece0166 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:24.983165 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a86ba9bb-65b8-49f8-a506-862522706cdd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:24.983737 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a86ba9bb-65b8-49f8-a506-862522706cdd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:24.984320 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2e0405b2-542c-496f-a772-088c5ece0166 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:24.984822 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a86ba9bb-65b8-49f8-a506-862522706cdd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:24.985702 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2e0405b2-542c-496f-a772-088c5ece0166 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:25.098932 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-a86ba9bb-65b8-49f8-a506-862522706cdd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:25.107794 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-a86ba9bb-65b8-49f8-a506-862522706cdd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a" status: 200 len: 1612 microversion: 2.1 time: 0.161993 Sep 02 05:30:25.109086 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 419/838] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:24 2022] GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a => generated 1612 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:25.251886 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-2e0405b2-542c-496f-a772-088c5ece0166 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:25.261550 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-2e0405b2-542c-496f-a772-088c5ece0166 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1569 microversion: 2.1 time: 0.310596 Sep 02 05:30:25.262496 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 420/839] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:24 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1569 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:25.283962 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-cd4a6eb9-d888-4806-8885-38f73f0682c7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:30:25.284948 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-cd4a6eb9-d888-4806-8885-38f73f0682c7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:25.291244 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cd4a6eb9-d888-4806-8885-38f73f0682c7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:25.291915 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cd4a6eb9-d888-4806-8885-38f73f0682c7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:25.292531 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cd4a6eb9-d888-4806-8885-38f73f0682c7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:25.293368 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cd4a6eb9-d888-4806-8885-38f73f0682c7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:25.293967 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cd4a6eb9-d888-4806-8885-38f73f0682c7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:25.294533 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cd4a6eb9-d888-4806-8885-38f73f0682c7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:25.349395 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-cd4a6eb9-d888-4806-8885-38f73f0682c7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120448) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 02 05:30:25.449895 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-cd4a6eb9-d888-4806-8885-38f73f0682c7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "POST /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1/action" status: 202 len: 0 microversion: 2.1 time: 0.169473 Sep 02 05:30:25.450931 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 420/840] 10.222.0.30 () {60 vars in 1278 bytes} [Fri Sep 2 05:30:25 2022] POST /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:30:25.456589 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-070e897c-69fa-44db-9ce1-5532fdb425b0 req-be48aa8a-2b2c-4f79-a719-2954fad0b56c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e74e8e64-b53c-431b-bb9c-34e58ee81d9a", "name": "network-vif-deleted", "tag": "873af418-880d-4d51-9eae-002944333a5c"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:30:25.461046 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-52c849d3-d02f-4d4c-97c5-33654cc4df27 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:25.462157 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-52c849d3-d02f-4d4c-97c5-33654cc4df27 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:25.470285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-52c849d3-d02f-4d4c-97c5-33654cc4df27 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:25.471000 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-52c849d3-d02f-4d4c-97c5-33654cc4df27 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:25.471431 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-52c849d3-d02f-4d4c-97c5-33654cc4df27 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:25.472370 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-52c849d3-d02f-4d4c-97c5-33654cc4df27 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:25.472835 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-52c849d3-d02f-4d4c-97c5-33654cc4df27 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:25.473246 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-52c849d3-d02f-4d4c-97c5-33654cc4df27 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:25.481811 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-070e897c-69fa-44db-9ce1-5532fdb425b0 req-be48aa8a-2b2c-4f79-a719-2954fad0b56c service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:25.482286 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-070e897c-69fa-44db-9ce1-5532fdb425b0 req-be48aa8a-2b2c-4f79-a719-2954fad0b56c service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:25.489225 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-070e897c-69fa-44db-9ce1-5532fdb425b0 req-be48aa8a-2b2c-4f79-a719-2954fad0b56c service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:25.520359 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-070e897c-69fa-44db-9ce1-5532fdb425b0 req-be48aa8a-2b2c-4f79-a719-2954fad0b56c service nova] Creating event network-vif-deleted:873af418-880d-4d51-9eae-002944333a5c for instance e74e8e64-b53c-431b-bb9c-34e58ee81d9a on hv-cinder-85391 Sep 02 05:30:25.526183 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-070e897c-69fa-44db-9ce1-5532fdb425b0 req-be48aa8a-2b2c-4f79-a719-2954fad0b56c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079156 Sep 02 05:30:25.527523 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 421/841] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 05:30:25.723551 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-52c849d3-d02f-4d4c-97c5-33654cc4df27 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:25.733234 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-52c849d3-d02f-4d4c-97c5-33654cc4df27 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1517 microversion: 2.1 time: 0.276412 Sep 02 05:30:25.734233 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 421/842] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:25 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1517 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:30:26.131069 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-9afb3929-f7df-4f05-9478-601e9d5e161c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:26.131963 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-9afb3929-f7df-4f05-9478-601e9d5e161c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:26.134274 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:30:26.140312 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9afb3929-f7df-4f05-9478-601e9d5e161c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:26.140786 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9afb3929-f7df-4f05-9478-601e9d5e161c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:26.141343 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9afb3929-f7df-4f05-9478-601e9d5e161c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:26.142251 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9afb3929-f7df-4f05-9478-601e9d5e161c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:26.142703 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9afb3929-f7df-4f05-9478-601e9d5e161c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:26.143108 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9afb3929-f7df-4f05-9478-601e9d5e161c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:26.149856 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:30:26.179889 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9afb3929-f7df-4f05-9478-601e9d5e161c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:26.180773 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9afb3929-f7df-4f05-9478-601e9d5e161c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:26.181292 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9afb3929-f7df-4f05-9478-601e9d5e161c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:26.181934 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.objects.instance [None req-9afb3929-f7df-4f05-9478-601e9d5e161c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lazy-loading 'fault' on Instance uuid e74e8e64-b53c-431b-bb9c-34e58ee81d9a {{(pid=120449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:30:26.231111 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-9afb3929-f7df-4f05-9478-601e9d5e161c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:26.270820 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-9afb3929-f7df-4f05-9478-601e9d5e161c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a" status: 200 len: 1330 microversion: 2.1 time: 0.144682 Sep 02 05:30:26.271739 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 422/843] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:26 2022] GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a => generated 1330 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:26.755134 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-1a418b02-58cd-4074-8bff-745ceaa69b91 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:26.755842 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-1a418b02-58cd-4074-8bff-745ceaa69b91 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:26.758485 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:30:26.763708 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1a418b02-58cd-4074-8bff-745ceaa69b91 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:26.764270 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1a418b02-58cd-4074-8bff-745ceaa69b91 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:26.764721 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1a418b02-58cd-4074-8bff-745ceaa69b91 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:26.765419 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1a418b02-58cd-4074-8bff-745ceaa69b91 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:26.765875 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1a418b02-58cd-4074-8bff-745ceaa69b91 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:26.766350 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1a418b02-58cd-4074-8bff-745ceaa69b91 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:26.905735 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-1a418b02-58cd-4074-8bff-745ceaa69b91 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:26.913615 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-1a418b02-58cd-4074-8bff-745ceaa69b91 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1519 microversion: 2.1 time: 0.162422 Sep 02 05:30:26.914204 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 422/844] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:26 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:27.292311 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5b45f249-007e-4495-845a-c369f2cb8b92 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:27.292927 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5b45f249-007e-4495-845a-c369f2cb8b92 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:27.299507 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5b45f249-007e-4495-845a-c369f2cb8b92 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:27.299989 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5b45f249-007e-4495-845a-c369f2cb8b92 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:27.300453 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5b45f249-007e-4495-845a-c369f2cb8b92 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:27.301728 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5b45f249-007e-4495-845a-c369f2cb8b92 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:27.301728 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5b45f249-007e-4495-845a-c369f2cb8b92 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:27.302138 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5b45f249-007e-4495-845a-c369f2cb8b92 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:27.316923 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.wsgi [None req-5b45f249-007e-4495-845a-c369f2cb8b92 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] HTTP exception thrown: Instance e74e8e64-b53c-431b-bb9c-34e58ee81d9a could not be found. Sep 02 05:30:27.318560 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5b45f249-007e-4495-845a-c369f2cb8b92 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Request method failure captured: Sep 02 05:30:27.318560 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: request: GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a HTTP/1.1 Sep 02 05:30:27.318560 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept: application/json Sep 02 05:30:27.318560 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept-Encoding: identity Sep 02 05:30:27.318560 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Connection: close Sep 02 05:30:27.318560 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Length: 0 Sep 02 05:30:27.318560 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Type: application/json Sep 02 05:30:27.318560 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Host: 10.222.0.30 Sep 02 05:30:27.318560 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Openstack-System-Scope: None Sep 02 05:30:27.318560 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: User-Agent: python-urllib3/1.26.12 Sep 02 05:30:27.318560 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Auth-Token: gAAAAABjEZM9sMpwUr9qoyGfMjDaBJ8P6YvBPQ-f9EMy1v-mwCEwm2r_bgyQO13MJw9PzuA9JX3XTWqubrdQgU1a6BCBynzOqQh_kSQW7GnBay9PYEuOinJQJVybarMVc5DymGEpqCE1wXufVXEiHhxifOsWWijBJ0RmMiTE9rG9XyLkwahJIcQ Sep 02 05:30:27.318560 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Id: None Sep 02 05:30:27.318560 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Name: None Sep 02 05:30:27.318560 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Identity-Status: Confirmed Sep 02 05:30:27.318560 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Is-Admin-Project: True Sep 02 05:30:27.318560 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Id: default Sep 02 05:30:27.318560 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Name: Default Sep 02 05:30:27.318560 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Id: 0847ca942df54b659e8723463ab72c65 Sep 02 05:30:27.318560 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Name: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:30:27.318560 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Role: member,reader Sep 02 05:30:27.318560 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Roles: member,reader Sep 02 05:30:27.320309 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0847ca942df54b659e8723463ab72c65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0847ca942df54b659e8723463ab72c65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0847ca942df54b659e8723463ab72c65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0847ca942df54b659e8723463ab72c65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:30:27.320309 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:30:27.320309 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Id: 0847ca942df54b659e8723463ab72c65 Sep 02 05:30:27.320309 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:30:27.320309 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User: tempest-AttachVolumeNegativeTest-1685577678-project Sep 02 05:30:27.320309 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Id: default Sep 02 05:30:27.320309 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Name: Default Sep 02 05:30:27.320309 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Id: ee1a3027b52f4b46bc5cff18f9cd0b02 Sep 02 05:30:27.320309 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Name: tempest-AttachVolumeNegativeTest-1685577678-project Sep 02 05:30:27.320309 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: method: > Sep 02 05:30:27.320309 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: exception: Instance e74e8e64-b53c-431b-bb9c-34e58ee81d9a could not be found. Sep 02 05:30:27.320309 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: action_args: {'id': 'e74e8e64-b53c-431b-bb9c-34e58ee81d9a'} Sep 02 05:30:27.321240 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:30:27.321240 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:30:27.321240 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:30:27.321240 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:30:27.321240 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:30:27.321240 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:30:27.321240 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:30:27.321240 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:30:27.321240 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:30:27.321240 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:30:27.321240 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e74e8e64-b53c-431b-bb9c-34e58ee81d9a could not be found. Sep 02 05:30:27.321240 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:30:27.321240 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:30:27.321240 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:30:27.321240 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:30:27.321240 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:30:27.321240 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:30:27.321240 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:30:27.321240 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:30:27.321240 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:30:27.322649 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:30:27.322649 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:30:27.322649 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:30:27.322649 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:30:27.322649 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:30:27.322649 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:30:27.322649 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:30:27.322649 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e74e8e64-b53c-431b-bb9c-34e58ee81d9a could not be found. Sep 02 05:30:27.322649 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:30:27.322649 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:30:27.322649 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:30:27.322649 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:30:27.322649 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:30:27.322649 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:30:27.322649 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:30:27.322649 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:30:27.322649 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e74e8e64-b53c-431b-bb9c-34e58ee81d9a could not be found. Sep 02 05:30:27.322649 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:30:27.324001 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5b45f249-007e-4495-845a-c369f2cb8b92 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Returning 404 to user: Instance e74e8e64-b53c-431b-bb9c-34e58ee81d9a could not be found. {{(pid=120449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:30:27.324001 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5b45f249-007e-4495-845a-c369f2cb8b92 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a" status: 404 len: 111 microversion: 2.1 time: 0.031704 Sep 02 05:30:27.324001 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 423/845] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:27 2022] GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:30:27.330319 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f64305ea-d888-4c21-8d6a-feb2e75db3b2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '.version_select at 0x7fc90ec449d0>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:27.357808 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f64305ea-d888-4c21-8d6a-feb2e75db3b2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-567933332" status: 202 len: 0 microversion: 2.1 time: 0.032491 Sep 02 05:30:27.358384 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 423/846] 10.222.0.30 () {58 vars in 1218 bytes} [Fri Sep 2 05:30:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-567933332 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:30:27.728104 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-e3909183-9c63-43dd-af10-0b2feb4f65d2 req-c30ad52c-ba5f-41aa-b74e-baf883869080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9feba72e-7abe-4be7-b75e-51262eb201a1", "name": "network-vif-unplugged", "status": "completed", "tag": "efc651b2-eb48-40f2-aa6e-8bca71be2b42"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:30:27.745068 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-e3909183-9c63-43dd-af10-0b2feb4f65d2 req-c30ad52c-ba5f-41aa-b74e-baf883869080 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:27.747753 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-e3909183-9c63-43dd-af10-0b2feb4f65d2 req-c30ad52c-ba5f-41aa-b74e-baf883869080 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:27.748465 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-e3909183-9c63-43dd-af10-0b2feb4f65d2 req-c30ad52c-ba5f-41aa-b74e-baf883869080 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:27.762720 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-e3909183-9c63-43dd-af10-0b2feb4f65d2 req-c30ad52c-ba5f-41aa-b74e-baf883869080 service nova] Creating event network-vif-unplugged:efc651b2-eb48-40f2-aa6e-8bca71be2b42 for instance 9feba72e-7abe-4be7-b75e-51262eb201a1 on hv-cinder-85391 Sep 02 05:30:27.771189 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-e3909183-9c63-43dd-af10-0b2feb4f65d2 req-c30ad52c-ba5f-41aa-b74e-baf883869080 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048869 Sep 02 05:30:27.771862 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 424/847] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:30:27.937256 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-c965fb7a-2f5b-4b02-a4ab-c11e56704587 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:27.937859 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-c965fb7a-2f5b-4b02-a4ab-c11e56704587 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:27.946427 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c965fb7a-2f5b-4b02-a4ab-c11e56704587 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:27.947276 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c965fb7a-2f5b-4b02-a4ab-c11e56704587 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:27.947950 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c965fb7a-2f5b-4b02-a4ab-c11e56704587 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:27.948696 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c965fb7a-2f5b-4b02-a4ab-c11e56704587 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:27.949157 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c965fb7a-2f5b-4b02-a4ab-c11e56704587 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:27.949611 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c965fb7a-2f5b-4b02-a4ab-c11e56704587 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:28.094112 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c965fb7a-2f5b-4b02-a4ab-c11e56704587 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:28.102619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-c965fb7a-2f5b-4b02-a4ab-c11e56704587 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1575 microversion: 2.1 time: 0.170462 Sep 02 05:30:28.103219 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 424/848] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:27 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:28.172076 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5626287a-cdb1-466f-ae75-6d5c1d7990c2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:28.172932 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5626287a-cdb1-466f-ae75-6d5c1d7990c2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:28.181969 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5626287a-cdb1-466f-ae75-6d5c1d7990c2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:28.182659 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5626287a-cdb1-466f-ae75-6d5c1d7990c2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:28.183284 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5626287a-cdb1-466f-ae75-6d5c1d7990c2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:28.184340 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5626287a-cdb1-466f-ae75-6d5c1d7990c2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:28.184983 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5626287a-cdb1-466f-ae75-6d5c1d7990c2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:28.185459 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5626287a-cdb1-466f-ae75-6d5c1d7990c2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:28.271142 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.objects.instance [None req-5626287a-cdb1-466f-ae75-6d5c1d7990c2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lazy-loading 'services' on Instance uuid 6ecefc31-2d93-4601-91e7-0d18da502d8b {{(pid=120449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:30:28.344818 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5626287a-cdb1-466f-ae75-6d5c1d7990c2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b/os-volume_attachments/cb70b01f-a826-47f2-a333-ea50559bdc18" status: 202 len: 0 microversion: 2.1 time: 0.179230 Sep 02 05:30:28.345587 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 425/849] 10.222.0.30 () {58 vars in 1416 bytes} [Fri Sep 2 05:30:28 2022] DELETE /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b/os-volume_attachments/cb70b01f-a826-47f2-a333-ea50559bdc18 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:30:28.354470 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-00bd912c-623e-4c94-a4f8-482215d7bf9f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:28.356981 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-00bd912c-623e-4c94-a4f8-482215d7bf9f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:28.364362 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-00bd912c-623e-4c94-a4f8-482215d7bf9f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:28.364848 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-00bd912c-623e-4c94-a4f8-482215d7bf9f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:28.365857 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-00bd912c-623e-4c94-a4f8-482215d7bf9f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:28.366580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-00bd912c-623e-4c94-a4f8-482215d7bf9f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:28.367032 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-00bd912c-623e-4c94-a4f8-482215d7bf9f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:28.367450 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-00bd912c-623e-4c94-a4f8-482215d7bf9f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:28.398910 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-00bd912c-623e-4c94-a4f8-482215d7bf9f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048778 Sep 02 05:30:28.399416 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 425/850] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Sep 2 05:30:28 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:30:29.124821 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-8a63a6a3-9e93-46b6-be1d-0c5a1e3a52c7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:29.125609 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-8a63a6a3-9e93-46b6-be1d-0c5a1e3a52c7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:29.132621 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8a63a6a3-9e93-46b6-be1d-0c5a1e3a52c7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:29.133132 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8a63a6a3-9e93-46b6-be1d-0c5a1e3a52c7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:29.133598 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8a63a6a3-9e93-46b6-be1d-0c5a1e3a52c7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:29.134291 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8a63a6a3-9e93-46b6-be1d-0c5a1e3a52c7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:29.134748 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8a63a6a3-9e93-46b6-be1d-0c5a1e3a52c7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:29.135207 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8a63a6a3-9e93-46b6-be1d-0c5a1e3a52c7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:29.366810 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-8a63a6a3-9e93-46b6-be1d-0c5a1e3a52c7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:29.377058 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-8a63a6a3-9e93-46b6-be1d-0c5a1e3a52c7 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1575 microversion: 2.1 time: 0.256679 Sep 02 05:30:29.377632 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 426/851] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:29 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1575 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:29.411287 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-84f69828-6aa7-4833-87f3-2389f9480bca tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:29.413506 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-84f69828-6aa7-4833-87f3-2389f9480bca tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:29.420568 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-84f69828-6aa7-4833-87f3-2389f9480bca tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:29.421223 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-84f69828-6aa7-4833-87f3-2389f9480bca tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:29.421750 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-84f69828-6aa7-4833-87f3-2389f9480bca tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:29.422587 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-84f69828-6aa7-4833-87f3-2389f9480bca tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:29.423143 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-84f69828-6aa7-4833-87f3-2389f9480bca tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:29.423757 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-84f69828-6aa7-4833-87f3-2389f9480bca tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:29.454247 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-84f69828-6aa7-4833-87f3-2389f9480bca tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046908 Sep 02 05:30:29.455170 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 426/852] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Sep 2 05:30:29 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:30:30.402072 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-724a8ca8-b7ce-468e-a08e-71c47f802e76 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:30.403066 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-724a8ca8-b7ce-468e-a08e-71c47f802e76 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:30.411839 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-724a8ca8-b7ce-468e-a08e-71c47f802e76 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:30.412365 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-724a8ca8-b7ce-468e-a08e-71c47f802e76 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:30.412802 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-724a8ca8-b7ce-468e-a08e-71c47f802e76 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:30.413490 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-724a8ca8-b7ce-468e-a08e-71c47f802e76 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:30.413968 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-724a8ca8-b7ce-468e-a08e-71c47f802e76 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:30.414369 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-724a8ca8-b7ce-468e-a08e-71c47f802e76 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:30.467144 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-6fe95467-fe5a-4dcc-abb3-eb0c9a2cdae3 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:30.469335 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-6fe95467-fe5a-4dcc-abb3-eb0c9a2cdae3 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:30.475961 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6fe95467-fe5a-4dcc-abb3-eb0c9a2cdae3 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:30.476451 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6fe95467-fe5a-4dcc-abb3-eb0c9a2cdae3 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:30.476910 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6fe95467-fe5a-4dcc-abb3-eb0c9a2cdae3 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:30.477633 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6fe95467-fe5a-4dcc-abb3-eb0c9a2cdae3 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:30.478078 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6fe95467-fe5a-4dcc-abb3-eb0c9a2cdae3 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:30.478497 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6fe95467-fe5a-4dcc-abb3-eb0c9a2cdae3 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:30.508390 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-6fe95467-fe5a-4dcc-abb3-eb0c9a2cdae3 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045099 Sep 02 05:30:30.509192 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 427/853] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Sep 2 05:30:30 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 05:30:30.554337 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-724a8ca8-b7ce-468e-a08e-71c47f802e76 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:30.562965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-724a8ca8-b7ce-468e-a08e-71c47f802e76 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1575 microversion: 2.1 time: 0.167646 Sep 02 05:30:30.563531 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 427/854] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:30 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:31.521840 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-78e85a54-a204-406f-8997-f438efe8431f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:31.522459 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-23f53459-a267-4319-9d0d-bf78468c0740 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:31.522821 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-78e85a54-a204-406f-8997-f438efe8431f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:31.524293 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-23f53459-a267-4319-9d0d-bf78468c0740 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:31.529183 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-78e85a54-a204-406f-8997-f438efe8431f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:31.529646 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-78e85a54-a204-406f-8997-f438efe8431f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:31.530106 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-78e85a54-a204-406f-8997-f438efe8431f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:31.530550 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-23f53459-a267-4319-9d0d-bf78468c0740 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:31.530766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-78e85a54-a204-406f-8997-f438efe8431f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:31.531030 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-23f53459-a267-4319-9d0d-bf78468c0740 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:31.531235 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-78e85a54-a204-406f-8997-f438efe8431f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:31.531464 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-23f53459-a267-4319-9d0d-bf78468c0740 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:31.531659 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-78e85a54-a204-406f-8997-f438efe8431f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:31.532195 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-23f53459-a267-4319-9d0d-bf78468c0740 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:31.532655 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-23f53459-a267-4319-9d0d-bf78468c0740 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:31.533094 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-23f53459-a267-4319-9d0d-bf78468c0740 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:31.561538 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-78e85a54-a204-406f-8997-f438efe8431f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d/os-volume_attachments/bf454366-22b4-4754-af60-4a9935a3bb0d" status: 200 len: 194 microversion: 2.20 time: 0.043848 Sep 02 05:30:31.562144 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 428/855] 10.222.0.30 () {60 vars in 1454 bytes} [Fri Sep 2 05:30:31 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d/os-volume_attachments/bf454366-22b4-4754-af60-4a9935a3bb0d => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 05:30:31.563666 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-23f53459-a267-4319-9d0d-bf78468c0740 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045626 Sep 02 05:30:31.564307 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 428/856] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Sep 2 05:30:31 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 05:30:31.583581 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-26055fab-1528-4885-beec-03980e11940a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:31.584195 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-26055fab-1528-4885-beec-03980e11940a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:31.590241 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-26055fab-1528-4885-beec-03980e11940a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:31.590743 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-26055fab-1528-4885-beec-03980e11940a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:31.591182 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-26055fab-1528-4885-beec-03980e11940a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:31.591886 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-26055fab-1528-4885-beec-03980e11940a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:31.592368 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-26055fab-1528-4885-beec-03980e11940a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:31.592787 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-26055fab-1528-4885-beec-03980e11940a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:31.630371 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-f4ef41e1-581d-4fe6-896c-51f6c88d86c5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:31.630867 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-f4ef41e1-581d-4fe6-896c-51f6c88d86c5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:31.637049 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f4ef41e1-581d-4fe6-896c-51f6c88d86c5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:31.637539 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f4ef41e1-581d-4fe6-896c-51f6c88d86c5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:31.637976 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f4ef41e1-581d-4fe6-896c-51f6c88d86c5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:31.638668 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f4ef41e1-581d-4fe6-896c-51f6c88d86c5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:31.639123 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f4ef41e1-581d-4fe6-896c-51f6c88d86c5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:31.639548 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f4ef41e1-581d-4fe6-896c-51f6c88d86c5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:31.729518 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-26055fab-1528-4885-beec-03980e11940a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:31.730426 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.objects.instance [None req-f4ef41e1-581d-4fe6-896c-51f6c88d86c5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lazy-loading 'services' on Instance uuid 1e32b402-d6f2-4861-a864-005e1a9f808d {{(pid=120449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:30:31.738505 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-26055fab-1528-4885-beec-03980e11940a tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1575 microversion: 2.1 time: 0.158509 Sep 02 05:30:31.739081 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 429/857] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:31 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:31.808228 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-f4ef41e1-581d-4fe6-896c-51f6c88d86c5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d/os-volume_attachments/bf454366-22b4-4754-af60-4a9935a3bb0d" status: 202 len: 0 microversion: 2.20 time: 0.181713 Sep 02 05:30:31.808796 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 429/858] 10.222.0.30 () {60 vars in 1457 bytes} [Fri Sep 2 05:30:31 2022] DELETE /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d/os-volume_attachments/bf454366-22b4-4754-af60-4a9935a3bb0d => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 05:30:31.817817 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-07045864-52f7-4184-a3f1-5ec9ce61adf6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:31.820155 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-07045864-52f7-4184-a3f1-5ec9ce61adf6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:31.826567 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-07045864-52f7-4184-a3f1-5ec9ce61adf6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:31.827297 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-07045864-52f7-4184-a3f1-5ec9ce61adf6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:31.827730 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-07045864-52f7-4184-a3f1-5ec9ce61adf6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:31.828526 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-07045864-52f7-4184-a3f1-5ec9ce61adf6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:31.829049 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-07045864-52f7-4184-a3f1-5ec9ce61adf6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:31.829538 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-07045864-52f7-4184-a3f1-5ec9ce61adf6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:31.861494 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-07045864-52f7-4184-a3f1-5ec9ce61adf6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047436 Sep 02 05:30:31.862417 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 430/859] 10.222.0.30 () {60 vars in 1343 bytes} [Fri Sep 2 05:30:31 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 05:30:32.580490 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-a5749deb-e31e-4b71-a0e5-2388c7959d2b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:32.583573 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-a5749deb-e31e-4b71-a0e5-2388c7959d2b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:32.592569 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a5749deb-e31e-4b71-a0e5-2388c7959d2b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:32.593148 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a5749deb-e31e-4b71-a0e5-2388c7959d2b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:32.593720 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a5749deb-e31e-4b71-a0e5-2388c7959d2b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:32.594393 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a5749deb-e31e-4b71-a0e5-2388c7959d2b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:32.594871 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a5749deb-e31e-4b71-a0e5-2388c7959d2b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:32.595314 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a5749deb-e31e-4b71-a0e5-2388c7959d2b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:32.625370 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-a5749deb-e31e-4b71-a0e5-2388c7959d2b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051942 Sep 02 05:30:32.625943 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 430/860] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Sep 2 05:30:32 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 05:30:32.687842 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-1738611f-8fcd-465f-9161-0dc7709f9667 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:32.688429 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-1738611f-8fcd-465f-9161-0dc7709f9667 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:32.696317 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1738611f-8fcd-465f-9161-0dc7709f9667 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:32.697035 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1738611f-8fcd-465f-9161-0dc7709f9667 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:32.698263 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1738611f-8fcd-465f-9161-0dc7709f9667 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:32.698512 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1738611f-8fcd-465f-9161-0dc7709f9667 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:32.699335 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1738611f-8fcd-465f-9161-0dc7709f9667 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:32.699838 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1738611f-8fcd-465f-9161-0dc7709f9667 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:32.720693 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:30:32.729661 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-1738611f-8fcd-465f-9161-0dc7709f9667 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Going to try to terminate instance {{(pid=120448) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 05:30:32.760742 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-932b106a-60f5-4362-b97f-02f9f475d801 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:32.761490 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-932b106a-60f5-4362-b97f-02f9f475d801 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:32.767947 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-932b106a-60f5-4362-b97f-02f9f475d801 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:32.768646 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-932b106a-60f5-4362-b97f-02f9f475d801 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:32.769165 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-932b106a-60f5-4362-b97f-02f9f475d801 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:32.770008 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-932b106a-60f5-4362-b97f-02f9f475d801 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:32.770427 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-932b106a-60f5-4362-b97f-02f9f475d801 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:32.770850 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-932b106a-60f5-4362-b97f-02f9f475d801 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:32.813663 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-1738611f-8fcd-465f-9161-0dc7709f9667 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 204 len: 0 microversion: 2.1 time: 0.129323 Sep 02 05:30:32.814845 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 431/861] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Sep 2 05:30:32 2022] DELETE /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 02 05:30:32.825423 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-046d3c0e-68c3-4b06-89c7-dff85b917f3c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:32.826120 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-046d3c0e-68c3-4b06-89c7-dff85b917f3c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:32.832165 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-046d3c0e-68c3-4b06-89c7-dff85b917f3c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:32.832574 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-046d3c0e-68c3-4b06-89c7-dff85b917f3c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:32.833021 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-046d3c0e-68c3-4b06-89c7-dff85b917f3c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:32.833678 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-046d3c0e-68c3-4b06-89c7-dff85b917f3c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:32.834121 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-046d3c0e-68c3-4b06-89c7-dff85b917f3c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:32.834537 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-046d3c0e-68c3-4b06-89c7-dff85b917f3c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:32.947977 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-932b106a-60f5-4362-b97f-02f9f475d801 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:32.956354 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-932b106a-60f5-4362-b97f-02f9f475d801 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1575 microversion: 2.1 time: 0.199872 Sep 02 05:30:32.956906 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 431/862] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:32 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1575 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:32.961523 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-c83c427b-5f68-413c-8513-0f2c39f18937 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:32.963669 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-c83c427b-5f68-413c-8513-0f2c39f18937 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:32.970318 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c83c427b-5f68-413c-8513-0f2c39f18937 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:32.970976 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c83c427b-5f68-413c-8513-0f2c39f18937 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:32.971504 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c83c427b-5f68-413c-8513-0f2c39f18937 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:32.972338 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c83c427b-5f68-413c-8513-0f2c39f18937 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:32.973736 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c83c427b-5f68-413c-8513-0f2c39f18937 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:32.974424 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c83c427b-5f68-413c-8513-0f2c39f18937 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:33.003664 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-046d3c0e-68c3-4b06-89c7-dff85b917f3c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:33.014778 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-c83c427b-5f68-413c-8513-0f2c39f18937 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056667 Sep 02 05:30:33.015349 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 432/863] 10.222.0.30 () {60 vars in 1343 bytes} [Fri Sep 2 05:30:32 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 05:30:33.028475 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-046d3c0e-68c3-4b06-89c7-dff85b917f3c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1680 microversion: 2.1 time: 0.208606 Sep 02 05:30:33.029060 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 432/864] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:32 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1680 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:30:33.981788 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-3e2c3d53-2ab6-4169-a9b8-5856faf25f74 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:33.982648 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-3e2c3d53-2ab6-4169-a9b8-5856faf25f74 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:33.991460 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3e2c3d53-2ab6-4169-a9b8-5856faf25f74 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:33.991921 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3e2c3d53-2ab6-4169-a9b8-5856faf25f74 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:33.992397 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3e2c3d53-2ab6-4169-a9b8-5856faf25f74 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:33.993099 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3e2c3d53-2ab6-4169-a9b8-5856faf25f74 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:33.993548 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3e2c3d53-2ab6-4169-a9b8-5856faf25f74 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:33.993980 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3e2c3d53-2ab6-4169-a9b8-5856faf25f74 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:34.027183 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-25098891-a43b-4eb5-ab73-7156fcd978de tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:34.029486 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-25098891-a43b-4eb5-ab73-7156fcd978de tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:34.036590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-25098891-a43b-4eb5-ab73-7156fcd978de tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:34.037080 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-25098891-a43b-4eb5-ab73-7156fcd978de tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:34.037517 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-25098891-a43b-4eb5-ab73-7156fcd978de tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:34.038215 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-25098891-a43b-4eb5-ab73-7156fcd978de tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:34.038667 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-25098891-a43b-4eb5-ab73-7156fcd978de tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:34.039087 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-25098891-a43b-4eb5-ab73-7156fcd978de tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:34.069200 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-25098891-a43b-4eb5-ab73-7156fcd978de tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045890 Sep 02 05:30:34.069782 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 433/865] 10.222.0.30 () {60 vars in 1343 bytes} [Fri Sep 2 05:30:34 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:34.074336 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-9ea752fa-61e3-4e47-ad72-f92ecfee9a43 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:34.074941 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-9ea752fa-61e3-4e47-ad72-f92ecfee9a43 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:34.081171 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9ea752fa-61e3-4e47-ad72-f92ecfee9a43 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:34.081612 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9ea752fa-61e3-4e47-ad72-f92ecfee9a43 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:34.082347 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9ea752fa-61e3-4e47-ad72-f92ecfee9a43 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:34.082732 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9ea752fa-61e3-4e47-ad72-f92ecfee9a43 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:34.083208 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9ea752fa-61e3-4e47-ad72-f92ecfee9a43 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:34.083636 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9ea752fa-61e3-4e47-ad72-f92ecfee9a43 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:34.172612 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-3e2c3d53-2ab6-4169-a9b8-5856faf25f74 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:34.181606 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-3e2c3d53-2ab6-4169-a9b8-5856faf25f74 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1575 microversion: 2.1 time: 0.206437 Sep 02 05:30:34.182312 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 433/866] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:33 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1575 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:34.187001 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-b076527d-2112-45cf-9388-b778905bf377 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:34.187487 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-b076527d-2112-45cf-9388-b778905bf377 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:34.193787 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b076527d-2112-45cf-9388-b778905bf377 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:34.194268 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b076527d-2112-45cf-9388-b778905bf377 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:34.194702 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b076527d-2112-45cf-9388-b778905bf377 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:34.195392 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b076527d-2112-45cf-9388-b778905bf377 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:34.195845 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b076527d-2112-45cf-9388-b778905bf377 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:34.196495 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b076527d-2112-45cf-9388-b778905bf377 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:34.222617 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-b076527d-2112-45cf-9388-b778905bf377 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Going to try to terminate instance {{(pid=120449) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 05:30:34.237162 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-9ea752fa-61e3-4e47-ad72-f92ecfee9a43 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:34.245297 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-9ea752fa-61e3-4e47-ad72-f92ecfee9a43 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1680 microversion: 2.1 time: 0.174575 Sep 02 05:30:34.245899 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 434/867] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:34 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:34.303858 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-b076527d-2112-45cf-9388-b778905bf377 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 204 len: 0 microversion: 2.20 time: 0.120282 Sep 02 05:30:34.304524 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 434/868] 10.222.0.30 () {60 vars in 1280 bytes} [Fri Sep 2 05:30:34 2022] DELETE /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 02 05:30:34.313539 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-96ad770c-b1fd-4b49-a469-14ffde44ec83 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:34.316035 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-96ad770c-b1fd-4b49-a469-14ffde44ec83 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:34.324348 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-96ad770c-b1fd-4b49-a469-14ffde44ec83 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:34.324916 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-96ad770c-b1fd-4b49-a469-14ffde44ec83 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:34.325472 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-96ad770c-b1fd-4b49-a469-14ffde44ec83 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:34.326236 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-96ad770c-b1fd-4b49-a469-14ffde44ec83 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:34.326837 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-96ad770c-b1fd-4b49-a469-14ffde44ec83 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:34.327344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-96ad770c-b1fd-4b49-a469-14ffde44ec83 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:34.463858 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-96ad770c-b1fd-4b49-a469-14ffde44ec83 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:34.476460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-96ad770c-b1fd-4b49-a469-14ffde44ec83 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:34.478901 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-96ad770c-b1fd-4b49-a469-14ffde44ec83 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:34.480413 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-96ad770c-b1fd-4b49-a469-14ffde44ec83 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1721 microversion: 2.20 time: 0.171128 Sep 02 05:30:34.481407 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 435/869] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:30:34 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:30:35.207072 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-56aa93fb-833b-4f24-9d2b-e8cbf4167f68 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:35.207768 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-56aa93fb-833b-4f24-9d2b-e8cbf4167f68 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:35.214617 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-56aa93fb-833b-4f24-9d2b-e8cbf4167f68 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:35.215072 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-56aa93fb-833b-4f24-9d2b-e8cbf4167f68 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:35.215529 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-56aa93fb-833b-4f24-9d2b-e8cbf4167f68 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:35.216229 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-56aa93fb-833b-4f24-9d2b-e8cbf4167f68 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:35.216696 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-56aa93fb-833b-4f24-9d2b-e8cbf4167f68 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:35.217118 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-56aa93fb-833b-4f24-9d2b-e8cbf4167f68 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:35.267120 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-da3927de-97ab-44c6-a8e4-e6ef3dc63aaa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:35.267971 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-da3927de-97ab-44c6-a8e4-e6ef3dc63aaa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:35.274559 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-da3927de-97ab-44c6-a8e4-e6ef3dc63aaa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:35.275043 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-da3927de-97ab-44c6-a8e4-e6ef3dc63aaa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:35.275476 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-da3927de-97ab-44c6-a8e4-e6ef3dc63aaa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:35.276195 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-da3927de-97ab-44c6-a8e4-e6ef3dc63aaa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:35.276731 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-da3927de-97ab-44c6-a8e4-e6ef3dc63aaa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:35.277341 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-da3927de-97ab-44c6-a8e4-e6ef3dc63aaa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:35.388248 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-56aa93fb-833b-4f24-9d2b-e8cbf4167f68 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:35.396808 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-56aa93fb-833b-4f24-9d2b-e8cbf4167f68 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1575 microversion: 2.1 time: 0.195759 Sep 02 05:30:35.397410 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 435/870] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:35 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1575 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:35.436395 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-da3927de-97ab-44c6-a8e4-e6ef3dc63aaa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:35.444601 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-da3927de-97ab-44c6-a8e4-e6ef3dc63aaa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1680 microversion: 2.1 time: 0.181379 Sep 02 05:30:35.445137 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 436/871] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:35 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:35.509212 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-923ae3c8-e67c-4450-924c-36be9755ddb5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:35.510034 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-923ae3c8-e67c-4450-924c-36be9755ddb5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:35.519050 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-923ae3c8-e67c-4450-924c-36be9755ddb5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:35.519534 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-923ae3c8-e67c-4450-924c-36be9755ddb5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:35.519964 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-923ae3c8-e67c-4450-924c-36be9755ddb5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:35.520712 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-923ae3c8-e67c-4450-924c-36be9755ddb5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:35.521159 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-923ae3c8-e67c-4450-924c-36be9755ddb5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:35.521588 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-923ae3c8-e67c-4450-924c-36be9755ddb5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:35.658168 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-923ae3c8-e67c-4450-924c-36be9755ddb5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:35.661735 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:30:35.666836 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-923ae3c8-e67c-4450-924c-36be9755ddb5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:35.668272 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-923ae3c8-e67c-4450-924c-36be9755ddb5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:35.669444 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-923ae3c8-e67c-4450-924c-36be9755ddb5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1721 microversion: 2.20 time: 0.166488 Sep 02 05:30:35.669989 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 436/872] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:30:35 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:30:36.418771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-48c47e76-82e5-4c29-b786-a769a5f096d3 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:36.419400 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-48c47e76-82e5-4c29-b786-a769a5f096d3 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:36.427739 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-48c47e76-82e5-4c29-b786-a769a5f096d3 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:36.428637 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-48c47e76-82e5-4c29-b786-a769a5f096d3 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:36.429077 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-48c47e76-82e5-4c29-b786-a769a5f096d3 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:36.429776 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-48c47e76-82e5-4c29-b786-a769a5f096d3 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:36.430239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-48c47e76-82e5-4c29-b786-a769a5f096d3 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:36.430654 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-48c47e76-82e5-4c29-b786-a769a5f096d3 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:36.468318 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-31577643-3631-462e-8463-a050b675a94e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:36.469246 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-31577643-3631-462e-8463-a050b675a94e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:36.480255 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-31577643-3631-462e-8463-a050b675a94e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:36.480751 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-31577643-3631-462e-8463-a050b675a94e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:36.481183 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-31577643-3631-462e-8463-a050b675a94e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:36.481891 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-31577643-3631-462e-8463-a050b675a94e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:36.482361 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-31577643-3631-462e-8463-a050b675a94e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:36.483213 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-31577643-3631-462e-8463-a050b675a94e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:36.574067 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-31577643-3631-462e-8463-a050b675a94e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:36.584355 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-31577643-3631-462e-8463-a050b675a94e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1613 microversion: 2.1 time: 0.121073 Sep 02 05:30:36.585225 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 437/873] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:36 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1613 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:36.651810 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-48c47e76-82e5-4c29-b786-a769a5f096d3 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:36.660590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-48c47e76-82e5-4c29-b786-a769a5f096d3 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1575 microversion: 2.1 time: 0.245930 Sep 02 05:30:36.661261 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 437/874] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:36 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1575 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:36.692689 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-f395ae3d-7902-486a-8acb-10baf1fe1153 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:36.693336 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-f395ae3d-7902-486a-8acb-10baf1fe1153 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:36.703454 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f395ae3d-7902-486a-8acb-10baf1fe1153 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:36.704454 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f395ae3d-7902-486a-8acb-10baf1fe1153 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:36.705176 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f395ae3d-7902-486a-8acb-10baf1fe1153 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:36.705956 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f395ae3d-7902-486a-8acb-10baf1fe1153 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:36.706784 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f395ae3d-7902-486a-8acb-10baf1fe1153 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:36.707071 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f395ae3d-7902-486a-8acb-10baf1fe1153 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:36.772261 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-484d74fa-492e-43c6-98cf-669bd003fecf req-85e511f6-a691-469b-9919-fb2e11cd1194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ecefc31-2d93-4601-91e7-0d18da502d8b", "name": "network-vif-deleted", "tag": "5c422bbe-4e68-47eb-b4b1-26e72bf162b6"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:30:36.782446 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-484d74fa-492e-43c6-98cf-669bd003fecf req-85e511f6-a691-469b-9919-fb2e11cd1194 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:36.783233 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-484d74fa-492e-43c6-98cf-669bd003fecf req-85e511f6-a691-469b-9919-fb2e11cd1194 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:36.783992 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-484d74fa-492e-43c6-98cf-669bd003fecf req-85e511f6-a691-469b-9919-fb2e11cd1194 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:36.797293 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-484d74fa-492e-43c6-98cf-669bd003fecf req-85e511f6-a691-469b-9919-fb2e11cd1194 service nova] Creating event network-vif-deleted:5c422bbe-4e68-47eb-b4b1-26e72bf162b6 for instance 6ecefc31-2d93-4601-91e7-0d18da502d8b on hv-cinder-85391 Sep 02 05:30:36.803472 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-484d74fa-492e-43c6-98cf-669bd003fecf req-85e511f6-a691-469b-9919-fb2e11cd1194 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034656 Sep 02 05:30:36.804750 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 438/875] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 05:30:36.882874 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-f395ae3d-7902-486a-8acb-10baf1fe1153 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:36.891248 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-f395ae3d-7902-486a-8acb-10baf1fe1153 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:36.892789 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-f395ae3d-7902-486a-8acb-10baf1fe1153 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:36.893952 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-f395ae3d-7902-486a-8acb-10baf1fe1153 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1721 microversion: 2.20 time: 0.205295 Sep 02 05:30:36.894510 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 438/876] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:30:36 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1721 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:30:37.608881 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-39b23f5f-cc28-400d-84b0-1681476d234e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:37.609612 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-39b23f5f-cc28-400d-84b0-1681476d234e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:37.617292 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-39b23f5f-cc28-400d-84b0-1681476d234e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:37.617785 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-39b23f5f-cc28-400d-84b0-1681476d234e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:37.618229 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-39b23f5f-cc28-400d-84b0-1681476d234e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:37.618939 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-39b23f5f-cc28-400d-84b0-1681476d234e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:37.619398 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-39b23f5f-cc28-400d-84b0-1681476d234e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:37.619823 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-39b23f5f-cc28-400d-84b0-1681476d234e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:37.682708 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-07c5fc03-dcba-4ec9-9748-c6c33778d77b tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:37.683349 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-07c5fc03-dcba-4ec9-9748-c6c33778d77b tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:37.691772 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-07c5fc03-dcba-4ec9-9748-c6c33778d77b tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:37.692896 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-07c5fc03-dcba-4ec9-9748-c6c33778d77b tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:37.693943 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-07c5fc03-dcba-4ec9-9748-c6c33778d77b tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:37.694829 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-07c5fc03-dcba-4ec9-9748-c6c33778d77b tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:37.695447 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-07c5fc03-dcba-4ec9-9748-c6c33778d77b tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:37.698141 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-07c5fc03-dcba-4ec9-9748-c6c33778d77b tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:37.940675 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-39b23f5f-cc28-400d-84b0-1681476d234e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:37.948829 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-39b23f5f-cc28-400d-84b0-1681476d234e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1326 microversion: 2.1 time: 0.345189 Sep 02 05:30:37.949400 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 439/877] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:37 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1326 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:37.954029 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-77797ac5-dbc5-4b5a-ad2f-256e3e944b63 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:37.954655 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-77797ac5-dbc5-4b5a-ad2f-256e3e944b63 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:37.960663 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-77797ac5-dbc5-4b5a-ad2f-256e3e944b63 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:37.961145 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-77797ac5-dbc5-4b5a-ad2f-256e3e944b63 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:37.961576 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-77797ac5-dbc5-4b5a-ad2f-256e3e944b63 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:37.962343 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-77797ac5-dbc5-4b5a-ad2f-256e3e944b63 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:37.962792 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-77797ac5-dbc5-4b5a-ad2f-256e3e944b63 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:37.963207 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-77797ac5-dbc5-4b5a-ad2f-256e3e944b63 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:38.082468 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-07c5fc03-dcba-4ec9-9748-c6c33778d77b tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:38.091830 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-07c5fc03-dcba-4ec9-9748-c6c33778d77b tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1575 microversion: 2.1 time: 0.413378 Sep 02 05:30:38.096758 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 439/878] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:37 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1575 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:30:38.132865 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-77797ac5-dbc5-4b5a-ad2f-256e3e944b63 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:38.141664 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-77797ac5-dbc5-4b5a-ad2f-256e3e944b63 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:38.143130 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-77797ac5-dbc5-4b5a-ad2f-256e3e944b63 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:38.146438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-77797ac5-dbc5-4b5a-ad2f-256e3e944b63 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1721 microversion: 2.20 time: 0.196073 Sep 02 05:30:38.147004 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 440/879] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:30:37 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:30:38.970293 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-12a53418-1070-477b-a841-666d0004bc33 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:38.970846 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-12a53418-1070-477b-a841-666d0004bc33 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:38.977867 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-12a53418-1070-477b-a841-666d0004bc33 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:38.978359 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-12a53418-1070-477b-a841-666d0004bc33 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:38.978800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-12a53418-1070-477b-a841-666d0004bc33 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:38.979495 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-12a53418-1070-477b-a841-666d0004bc33 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:38.979956 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-12a53418-1070-477b-a841-666d0004bc33 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:38.980417 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-12a53418-1070-477b-a841-666d0004bc33 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:39.044761 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-12a53418-1070-477b-a841-666d0004bc33 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:39.054873 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-12a53418-1070-477b-a841-666d0004bc33 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 200 len: 1326 microversion: 2.1 time: 0.087021 Sep 02 05:30:39.055504 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 440/880] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:38 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 1326 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:39.115209 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-b6fecc9b-812d-46e8-931c-b24f0e295b14 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:39.115833 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-b6fecc9b-812d-46e8-931c-b24f0e295b14 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:39.122576 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b6fecc9b-812d-46e8-931c-b24f0e295b14 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:39.123058 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b6fecc9b-812d-46e8-931c-b24f0e295b14 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:39.123488 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b6fecc9b-812d-46e8-931c-b24f0e295b14 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:39.124212 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b6fecc9b-812d-46e8-931c-b24f0e295b14 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:39.124659 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b6fecc9b-812d-46e8-931c-b24f0e295b14 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:39.125102 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b6fecc9b-812d-46e8-931c-b24f0e295b14 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:39.170149 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-6ca689b6-99b2-4ecf-bf4b-4dc98b0750f1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:39.170767 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-6ca689b6-99b2-4ecf-bf4b-4dc98b0750f1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:39.177428 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6ca689b6-99b2-4ecf-bf4b-4dc98b0750f1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:39.177428 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6ca689b6-99b2-4ecf-bf4b-4dc98b0750f1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:39.177862 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6ca689b6-99b2-4ecf-bf4b-4dc98b0750f1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:39.178569 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6ca689b6-99b2-4ecf-bf4b-4dc98b0750f1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:39.179028 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6ca689b6-99b2-4ecf-bf4b-4dc98b0750f1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:39.179458 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6ca689b6-99b2-4ecf-bf4b-4dc98b0750f1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:39.408207 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-b6fecc9b-812d-46e8-931c-b24f0e295b14 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:39.427560 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-b6fecc9b-812d-46e8-931c-b24f0e295b14 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1575 microversion: 2.1 time: 0.316311 Sep 02 05:30:39.429612 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 441/881] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:39 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1575 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:39.512091 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-6ca689b6-99b2-4ecf-bf4b-4dc98b0750f1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:39.520352 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-6ca689b6-99b2-4ecf-bf4b-4dc98b0750f1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:39.521782 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-6ca689b6-99b2-4ecf-bf4b-4dc98b0750f1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:39.522952 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-6ca689b6-99b2-4ecf-bf4b-4dc98b0750f1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1721 microversion: 2.20 time: 0.356810 Sep 02 05:30:39.523692 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 441/882] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:30:39 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1721 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:30:40.075936 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-a7918022-c866-4ab0-81a2-862901e6f956 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:40.076601 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-a7918022-c866-4ab0-81a2-862901e6f956 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:40.082613 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a7918022-c866-4ab0-81a2-862901e6f956 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:40.083097 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a7918022-c866-4ab0-81a2-862901e6f956 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:40.083531 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a7918022-c866-4ab0-81a2-862901e6f956 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:40.084269 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a7918022-c866-4ab0-81a2-862901e6f956 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:40.084739 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a7918022-c866-4ab0-81a2-862901e6f956 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:40.085160 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a7918022-c866-4ab0-81a2-862901e6f956 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:40.098735 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.wsgi [None req-a7918022-c866-4ab0-81a2-862901e6f956 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] HTTP exception thrown: Instance 6ecefc31-2d93-4601-91e7-0d18da502d8b could not be found. Sep 02 05:30:40.100532 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-a7918022-c866-4ab0-81a2-862901e6f956 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Request method failure captured: Sep 02 05:30:40.100532 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: request: GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b HTTP/1.1 Sep 02 05:30:40.100532 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept: application/json Sep 02 05:30:40.100532 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept-Encoding: identity Sep 02 05:30:40.100532 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Connection: close Sep 02 05:30:40.100532 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Length: 0 Sep 02 05:30:40.100532 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Type: application/json Sep 02 05:30:40.100532 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Host: 10.222.0.30 Sep 02 05:30:40.100532 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Openstack-System-Scope: None Sep 02 05:30:40.100532 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: User-Agent: python-urllib3/1.26.12 Sep 02 05:30:40.100532 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Auth-Token: gAAAAABjEZM9sMpwUr9qoyGfMjDaBJ8P6YvBPQ-f9EMy1v-mwCEwm2r_bgyQO13MJw9PzuA9JX3XTWqubrdQgU1a6BCBynzOqQh_kSQW7GnBay9PYEuOinJQJVybarMVc5DymGEpqCE1wXufVXEiHhxifOsWWijBJ0RmMiTE9rG9XyLkwahJIcQ Sep 02 05:30:40.100532 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Id: None Sep 02 05:30:40.100532 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Name: None Sep 02 05:30:40.100532 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Identity-Status: Confirmed Sep 02 05:30:40.100532 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Is-Admin-Project: True Sep 02 05:30:40.100532 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Id: default Sep 02 05:30:40.100532 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Name: Default Sep 02 05:30:40.100532 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Id: 0847ca942df54b659e8723463ab72c65 Sep 02 05:30:40.100532 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Name: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:30:40.100532 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Role: member,reader Sep 02 05:30:40.100532 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Roles: member,reader Sep 02 05:30:40.101996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0847ca942df54b659e8723463ab72c65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0847ca942df54b659e8723463ab72c65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0847ca942df54b659e8723463ab72c65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0847ca942df54b659e8723463ab72c65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:30:40.101996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:30:40.101996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Id: 0847ca942df54b659e8723463ab72c65 Sep 02 05:30:40.101996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:30:40.101996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User: tempest-AttachVolumeNegativeTest-1685577678-project Sep 02 05:30:40.101996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Id: default Sep 02 05:30:40.101996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Name: Default Sep 02 05:30:40.101996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Id: ee1a3027b52f4b46bc5cff18f9cd0b02 Sep 02 05:30:40.101996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Name: tempest-AttachVolumeNegativeTest-1685577678-project Sep 02 05:30:40.101996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: method: > Sep 02 05:30:40.101996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: exception: Instance 6ecefc31-2d93-4601-91e7-0d18da502d8b could not be found. Sep 02 05:30:40.101996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: action_args: {'id': '6ecefc31-2d93-4601-91e7-0d18da502d8b'} Sep 02 05:30:40.102908 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:30:40.102908 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:30:40.102908 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:30:40.102908 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:30:40.102908 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:30:40.102908 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:30:40.102908 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:30:40.102908 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:30:40.102908 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:30:40.102908 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:30:40.102908 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ecefc31-2d93-4601-91e7-0d18da502d8b could not be found. Sep 02 05:30:40.102908 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:30:40.102908 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:30:40.102908 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:30:40.102908 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:30:40.102908 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:30:40.102908 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:30:40.102908 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:30:40.102908 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:30:40.102908 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:30:40.104485 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:30:40.104485 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:30:40.104485 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:30:40.104485 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:30:40.104485 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:30:40.104485 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:30:40.104485 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:30:40.104485 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ecefc31-2d93-4601-91e7-0d18da502d8b could not be found. Sep 02 05:30:40.104485 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:30:40.104485 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:30:40.104485 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:30:40.104485 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:30:40.104485 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:30:40.104485 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:30:40.104485 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:30:40.104485 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:30:40.104485 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ecefc31-2d93-4601-91e7-0d18da502d8b could not be found. Sep 02 05:30:40.104485 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:30:40.105950 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-a7918022-c866-4ab0-81a2-862901e6f956 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Returning 404 to user: Instance 6ecefc31-2d93-4601-91e7-0d18da502d8b could not be found. {{(pid=120448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:30:40.105950 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-a7918022-c866-4ab0-81a2-862901e6f956 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 404 len: 111 microversion: 2.1 time: 0.029975 Sep 02 05:30:40.105950 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 442/883] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:40 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:30:40.111303 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-49b5b78a-1a55-428c-ae3b-85677b7c8882 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '.version_select at 0x7fc90b2520d0>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:40.136093 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-49b5b78a-1a55-428c-ae3b-85677b7c8882 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1072050948" status: 202 len: 0 microversion: 2.1 time: 0.028610 Sep 02 05:30:40.136697 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 442/884] 10.222.0.30 () {58 vars in 1221 bytes} [Fri Sep 2 05:30:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1072050948 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:30:40.211600 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-c054e58a-a6f5-4f68-beab-4a403179943f req-9ee28555-a9b7-4a16-9cb2-b2b4e2d6c05a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e32b402-d6f2-4861-a864-005e1a9f808d", "name": "network-vif-deleted", "tag": "26f374c2-ecf9-4064-b5ad-13f47d97521e"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:30:40.223320 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-c054e58a-a6f5-4f68-beab-4a403179943f req-9ee28555-a9b7-4a16-9cb2-b2b4e2d6c05a service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:40.223808 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-c054e58a-a6f5-4f68-beab-4a403179943f req-9ee28555-a9b7-4a16-9cb2-b2b4e2d6c05a service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:40.224271 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-c054e58a-a6f5-4f68-beab-4a403179943f req-9ee28555-a9b7-4a16-9cb2-b2b4e2d6c05a service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:40.245832 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-c054e58a-a6f5-4f68-beab-4a403179943f req-9ee28555-a9b7-4a16-9cb2-b2b4e2d6c05a service nova] Creating event network-vif-deleted:26f374c2-ecf9-4064-b5ad-13f47d97521e for instance 1e32b402-d6f2-4861-a864-005e1a9f808d on hv-cinder-85391 Sep 02 05:30:40.252726 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-c054e58a-a6f5-4f68-beab-4a403179943f req-9ee28555-a9b7-4a16-9cb2-b2b4e2d6c05a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044586 Sep 02 05:30:40.253684 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 443/885] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:30:40.449822 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-d2431811-c696-4d89-8b12-79b930aeb6b3 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:40.450396 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-d2431811-c696-4d89-8b12-79b930aeb6b3 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:40.466342 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d2431811-c696-4d89-8b12-79b930aeb6b3 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:40.467188 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d2431811-c696-4d89-8b12-79b930aeb6b3 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:40.467849 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d2431811-c696-4d89-8b12-79b930aeb6b3 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:40.469315 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d2431811-c696-4d89-8b12-79b930aeb6b3 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:40.471657 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d2431811-c696-4d89-8b12-79b930aeb6b3 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:40.472253 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d2431811-c696-4d89-8b12-79b930aeb6b3 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:40.546752 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d375426e-e370-46f4-ba08-0995d49624c5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:40.547761 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-d375426e-e370-46f4-ba08-0995d49624c5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:40.560871 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d375426e-e370-46f4-ba08-0995d49624c5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:40.561625 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d375426e-e370-46f4-ba08-0995d49624c5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:40.563489 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d375426e-e370-46f4-ba08-0995d49624c5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:40.564474 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d375426e-e370-46f4-ba08-0995d49624c5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:40.567289 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d375426e-e370-46f4-ba08-0995d49624c5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:40.569609 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d375426e-e370-46f4-ba08-0995d49624c5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:40.651113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d375426e-e370-46f4-ba08-0995d49624c5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:40.651619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d375426e-e370-46f4-ba08-0995d49624c5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:40.652059 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d375426e-e370-46f4-ba08-0995d49624c5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:40.652560 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.objects.instance [None req-d375426e-e370-46f4-ba08-0995d49624c5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lazy-loading 'fault' on Instance uuid 1e32b402-d6f2-4861-a864-005e1a9f808d {{(pid=120448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:30:40.723339 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d375426e-e370-46f4-ba08-0995d49624c5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:40.737388 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d375426e-e370-46f4-ba08-0995d49624c5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:40.739181 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d375426e-e370-46f4-ba08-0995d49624c5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:40.740689 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-d375426e-e370-46f4-ba08-0995d49624c5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 200 len: 1371 microversion: 2.20 time: 0.198337 Sep 02 05:30:40.741249 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 444/886] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:30:40 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:30:40.750975 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-d2431811-c696-4d89-8b12-79b930aeb6b3 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:40.759652 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-d2431811-c696-4d89-8b12-79b930aeb6b3 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1575 microversion: 2.1 time: 0.313758 Sep 02 05:30:40.761630 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 443/887] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:40 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1575 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:40.993523 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-556efcfd-6809-4a39-9e3c-cce1fa085479 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Action: 'create', calling method: .version_select at 0x7fc90ec44d30>, body: {"keypair": {"name": "tempest-keypair-368429421", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpZTD7dRwICUR4XNCZWjx2ovun1sUIRumXR84meuqlo/oRPSUFySiROV3z3MPerab8lX0Sv2vd9GH66tcZRAfpgQfch0u9IMjexn8JY4QErgouYb8mwK1aA1KB0bGO34g=="}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:30:41.009989 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-556efcfd-6809-4a39-9e3c-cce1fa085479 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Getting quotas for project 0847ca942df54b659e8723463ab72c65. Resources: {'key_pairs'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:30:41.014128 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-556efcfd-6809-4a39-9e3c-cce1fa085479 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Getting quotas for user ee1a3027b52f4b46bc5cff18f9cd0b02 and project 0847ca942df54b659e8723463ab72c65. Resources: {'key_pairs'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:30:41.037828 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-556efcfd-6809-4a39-9e3c-cce1fa085479 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049990 Sep 02 05:30:41.038426 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 445/888] 10.222.0.30 () {60 vars in 1159 bytes} [Fri Sep 2 05:30:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:30:41.764851 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-18c66cb4-2ecc-42f1-b013-0cf669a8422c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:41.765490 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-18c66cb4-2ecc-42f1-b013-0cf669a8422c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:41.772075 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-18c66cb4-2ecc-42f1-b013-0cf669a8422c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:41.775428 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-18c66cb4-2ecc-42f1-b013-0cf669a8422c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:41.775859 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-18c66cb4-2ecc-42f1-b013-0cf669a8422c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:41.776629 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-18c66cb4-2ecc-42f1-b013-0cf669a8422c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:41.777083 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-18c66cb4-2ecc-42f1-b013-0cf669a8422c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:41.777725 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-18c66cb4-2ecc-42f1-b013-0cf669a8422c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:41.784230 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-a55e876b-a705-40d2-aa40-522d3042a295 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:41.785168 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-a55e876b-a705-40d2-aa40-522d3042a295 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:41.792218 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.wsgi [None req-18c66cb4-2ecc-42f1-b013-0cf669a8422c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] HTTP exception thrown: Instance 1e32b402-d6f2-4861-a864-005e1a9f808d could not be found. Sep 02 05:30:41.794105 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a55e876b-a705-40d2-aa40-522d3042a295 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:41.794345 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-18c66cb4-2ecc-42f1-b013-0cf669a8422c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Request method failure captured: Sep 02 05:30:41.794345 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: request: GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d HTTP/1.1 Sep 02 05:30:41.794345 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept: application/json Sep 02 05:30:41.794345 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept-Encoding: identity Sep 02 05:30:41.794345 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Connection: close Sep 02 05:30:41.794345 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Length: 0 Sep 02 05:30:41.794345 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Type: application/json Sep 02 05:30:41.794345 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Host: 10.222.0.30 Sep 02 05:30:41.794345 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Openstack-System-Scope: None Sep 02 05:30:41.794345 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: User-Agent: python-urllib3/1.26.12 Sep 02 05:30:41.794345 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Auth-Token: gAAAAABjEZNHHK1IbaiBqBFmA-MnaPh2VqL5ADErh1ykHe-RFz6tId62cDWk6A0VQdlbG6jfmhnj88mSUBoVxx4qtnBjnjsYvT1POjPXTTvBEN6YFEtMftnpId532hIiXEdegWNs7gxD33mKm9D6aagYTbOPubYtBX6NgvZXsF9xl9gQoUzpGTs Sep 02 05:30:41.794345 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Id: None Sep 02 05:30:41.794345 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Name: None Sep 02 05:30:41.794345 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Identity-Status: Confirmed Sep 02 05:30:41.794345 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Is-Admin-Project: True Sep 02 05:30:41.794345 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Openstack-Nova-Api-Version: 2.20 Sep 02 05:30:41.794345 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Id: default Sep 02 05:30:41.794345 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Name: Default Sep 02 05:30:41.794345 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Id: 11ca1d5cfab24589b53707dea9790e26 Sep 02 05:30:41.794345 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-151451576 Sep 02 05:30:41.794345 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Role: member,reader Sep 02 05:30:41.794345 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Roles: member,reader Sep 02 05:30:41.795801 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_11ca1d5cfab24589b53707dea9790e26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11ca1d5cfab24589b53707dea9790e26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/11ca1d5cfab24589b53707dea9790e26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11ca1d5cfab24589b53707dea9790e26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:30:41.795801 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant: tempest-AttachVolumeShelveTestJSON-151451576 Sep 02 05:30:41.795801 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Id: 11ca1d5cfab24589b53707dea9790e26 Sep 02 05:30:41.795801 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-151451576 Sep 02 05:30:41.795801 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User: tempest-AttachVolumeShelveTestJSON-151451576-project Sep 02 05:30:41.795801 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Id: default Sep 02 05:30:41.795801 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Name: Default Sep 02 05:30:41.795801 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Id: f47ca04b60554047b0541de359bafd26 Sep 02 05:30:41.795801 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Name: tempest-AttachVolumeShelveTestJSON-151451576-project Sep 02 05:30:41.795801 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: method: > Sep 02 05:30:41.795801 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: exception: Instance 1e32b402-d6f2-4861-a864-005e1a9f808d could not be found. Sep 02 05:30:41.795801 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: action_args: {'id': '1e32b402-d6f2-4861-a864-005e1a9f808d'} Sep 02 05:30:41.797181 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:30:41.797181 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:30:41.797181 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:30:41.797181 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:30:41.797181 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:30:41.797181 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:30:41.797181 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:30:41.797181 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:30:41.797181 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:30:41.797181 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:30:41.797181 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e32b402-d6f2-4861-a864-005e1a9f808d could not be found. Sep 02 05:30:41.797181 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:30:41.797181 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:30:41.797181 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:30:41.797181 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:30:41.797181 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:30:41.797181 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:30:41.797181 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:30:41.797181 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:30:41.797181 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:30:41.798771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:30:41.798771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:30:41.798771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:30:41.798771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:30:41.798771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:30:41.798771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:30:41.798771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:30:41.798771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e32b402-d6f2-4861-a864-005e1a9f808d could not be found. Sep 02 05:30:41.798771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:30:41.798771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:30:41.798771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:30:41.798771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:30:41.798771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:30:41.798771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:30:41.798771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:30:41.798771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:30:41.798771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e32b402-d6f2-4861-a864-005e1a9f808d could not be found. Sep 02 05:30:41.798771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:30:41.800728 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a55e876b-a705-40d2-aa40-522d3042a295 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:41.800818 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-18c66cb4-2ecc-42f1-b013-0cf669a8422c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Returning 404 to user: Instance 1e32b402-d6f2-4861-a864-005e1a9f808d could not be found. {{(pid=120449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:30:41.800954 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a55e876b-a705-40d2-aa40-522d3042a295 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:41.801100 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-18c66cb4-2ecc-42f1-b013-0cf669a8422c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 404 len: 111 microversion: 2.20 time: 0.034879 Sep 02 05:30:41.801198 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a55e876b-a705-40d2-aa40-522d3042a295 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:41.801296 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 444/889] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:30:41 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 02 05:30:41.801392 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a55e876b-a705-40d2-aa40-522d3042a295 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:41.801392 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a55e876b-a705-40d2-aa40-522d3042a295 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:41.805925 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-3a22ab93-52cf-4ea4-bfb5-4f2d253655ca tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '.version_select at 0x7fc90b2a2040>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:41.826677 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-3a22ab93-52cf-4ea4-bfb5-4f2d253655ca tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1595938782" status: 204 len: 0 microversion: 2.20 time: 0.024473 Sep 02 05:30:41.827251 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 445/890] 10.222.0.30 () {60 vars in 1262 bytes} [Fri Sep 2 05:30:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1595938782 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 02 05:30:42.030720 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-a55e876b-a705-40d2-aa40-522d3042a295 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:42.042881 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-a55e876b-a705-40d2-aa40-522d3042a295 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1575 microversion: 2.1 time: 0.263398 Sep 02 05:30:42.046408 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 446/891] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:41 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1575 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:30:42.066202 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-92d6ae7b-7be8-416f-8120-cc334a1fe417 req-c7c8ed0b-bcaf-474b-b73d-ad6666b6c710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9feba72e-7abe-4be7-b75e-51262eb201a1", "name": "network-vif-plugged", "status": "completed", "tag": "efc651b2-eb48-40f2-aa6e-8bca71be2b42"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:30:42.079875 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-92d6ae7b-7be8-416f-8120-cc334a1fe417 req-c7c8ed0b-bcaf-474b-b73d-ad6666b6c710 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:42.080539 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-92d6ae7b-7be8-416f-8120-cc334a1fe417 req-c7c8ed0b-bcaf-474b-b73d-ad6666b6c710 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:42.081172 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-92d6ae7b-7be8-416f-8120-cc334a1fe417 req-c7c8ed0b-bcaf-474b-b73d-ad6666b6c710 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:42.097835 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-92d6ae7b-7be8-416f-8120-cc334a1fe417 req-c7c8ed0b-bcaf-474b-b73d-ad6666b6c710 service nova] Creating event network-vif-plugged:efc651b2-eb48-40f2-aa6e-8bca71be2b42 for instance 9feba72e-7abe-4be7-b75e-51262eb201a1 on hv-cinder-85391 Sep 02 05:30:42.103251 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-92d6ae7b-7be8-416f-8120-cc334a1fe417 req-c7c8ed0b-bcaf-474b-b73d-ad6666b6c710 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056583 Sep 02 05:30:42.104528 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 446/892] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 05:30:42.403091 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-98f22d92-d1ca-431d-a71a-df1f34a15ce2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1441039160", "imageRef": "f3669111-2e3f-4f39-878f-19d263505eaa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64176975-8c6d-4d21-8413-773e395248ec"}], "security_groups": [{"name": "tempest-securitygroup--277083992"}], "key_name": "tempest-keypair-368429421", "user_data": "}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:30:42.566826 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.network.neutron [None req-98f22d92-d1ca-431d-a71a-df1f34a15ce2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] validate_networks() for [('64176975-8c6d-4d21-8413-773e395248ec', None, None, None, None, None)] {{(pid=120448) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 05:30:42.908792 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-469fc691-05e5-4fc2-9a0d-4c02c5ab0a3d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Action: 'create', calling method: .version_select at 0x7fc90b2d0ca0>, body: {"keypair": {"name": "tempest-keypair-92141164", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgiEzvN6IroP2u1oby0RMb/hvNVaiCH7IOBDYrgO1O0FEEr6Kyvvh2wysiY5PwB9IKleXfwFiSqDSaYfYi1Z2cu+cmiKS5axrp+QVMjBP74FToEx9N/8xWkv2wgpOIY1Q=="}} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:30:42.926337 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.quota [None req-469fc691-05e5-4fc2-9a0d-4c02c5ab0a3d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Getting quotas for project 11ca1d5cfab24589b53707dea9790e26. Resources: {'key_pairs'} {{(pid=120449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:30:42.930431 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.quota [None req-469fc691-05e5-4fc2-9a0d-4c02c5ab0a3d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Getting quotas for user f47ca04b60554047b0541de359bafd26 and project 11ca1d5cfab24589b53707dea9790e26. Resources: {'key_pairs'} {{(pid=120449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:30:42.953123 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-469fc691-05e5-4fc2-9a0d-4c02c5ab0a3d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.051134 Sep 02 05:30:42.953637 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 447/893] 10.222.0.30 () {62 vars in 1200 bytes} [Fri Sep 2 05:30:42 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 02 05:30:43.069688 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-e8b4f835-9abe-45eb-b617-3e47ed8ef29e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:43.070795 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-e8b4f835-9abe-45eb-b617-3e47ed8ef29e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:43.078409 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e8b4f835-9abe-45eb-b617-3e47ed8ef29e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:43.079054 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e8b4f835-9abe-45eb-b617-3e47ed8ef29e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:43.079615 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e8b4f835-9abe-45eb-b617-3e47ed8ef29e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:43.080464 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e8b4f835-9abe-45eb-b617-3e47ed8ef29e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:43.081186 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e8b4f835-9abe-45eb-b617-3e47ed8ef29e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:43.081811 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e8b4f835-9abe-45eb-b617-3e47ed8ef29e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:43.090492 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-98f22d92-d1ca-431d-a71a-df1f34a15ce2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Flavor limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 05:30:43.091065 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-98f22d92-d1ca-431d-a71a-df1f34a15ce2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Image limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 05:30:43.091505 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-98f22d92-d1ca-431d-a71a-df1f34a15ce2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Flavor pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 05:30:43.091978 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-98f22d92-d1ca-431d-a71a-df1f34a15ce2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Image pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 05:30:43.092429 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-98f22d92-d1ca-431d-a71a-df1f34a15ce2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 05:30:43.102628 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-98f22d92-d1ca-431d-a71a-df1f34a15ce2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:43.103116 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-98f22d92-d1ca-431d-a71a-df1f34a15ce2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:43.103613 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-98f22d92-d1ca-431d-a71a-df1f34a15ce2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:43.104570 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-98f22d92-d1ca-431d-a71a-df1f34a15ce2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:43.106123 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-98f22d92-d1ca-431d-a71a-df1f34a15ce2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:43.106739 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-98f22d92-d1ca-431d-a71a-df1f34a15ce2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:43.128614 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-98f22d92-d1ca-431d-a71a-df1f34a15ce2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Getting quotas for project 0847ca942df54b659e8723463ab72c65. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:30:43.135948 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-98f22d92-d1ca-431d-a71a-df1f34a15ce2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Getting quotas for user ee1a3027b52f4b46bc5cff18f9cd0b02 and project 0847ca942df54b659e8723463ab72c65. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:30:43.149424 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-98f22d92-d1ca-431d-a71a-df1f34a15ce2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Going to run 1 instances... {{(pid=120448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 05:30:43.151904 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-98f22d92-d1ca-431d-a71a-df1f34a15ce2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3669111-2e3f-4f39-878f-19d263505eaa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 05:30:43.205887 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-98f22d92-d1ca-431d-a71a-df1f34a15ce2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.806914 Sep 02 05:30:43.206746 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 447/894] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Sep 2 05:30:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 05:30:43.220419 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-022fee95-0186-47b0-83ff-a7057bd694a9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:43.224802 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-022fee95-0186-47b0-83ff-a7057bd694a9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:43.300829 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-022fee95-0186-47b0-83ff-a7057bd694a9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:43.309530 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-022fee95-0186-47b0-83ff-a7057bd694a9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0" status: 200 len: 1241 microversion: 2.1 time: 0.093087 Sep 02 05:30:43.316260 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 448/895] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:43 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0 => generated 1241 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:43.328160 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e8b4f835-9abe-45eb-b617-3e47ed8ef29e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:43.337841 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-e8b4f835-9abe-45eb-b617-3e47ed8ef29e tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1575 microversion: 2.1 time: 0.271880 Sep 02 05:30:43.339133 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 448/896] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:43 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1575 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:30:44.330916 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-b30e7d92-2d87-45c7-99e3-66434dcd0d64 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:44.331503 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-b30e7d92-2d87-45c7-99e3-66434dcd0d64 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:44.338519 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b30e7d92-2d87-45c7-99e3-66434dcd0d64 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:44.338997 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b30e7d92-2d87-45c7-99e3-66434dcd0d64 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:44.339422 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b30e7d92-2d87-45c7-99e3-66434dcd0d64 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:44.340099 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b30e7d92-2d87-45c7-99e3-66434dcd0d64 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:44.340578 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b30e7d92-2d87-45c7-99e3-66434dcd0d64 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:44.340994 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b30e7d92-2d87-45c7-99e3-66434dcd0d64 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:44.360765 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-c77c9848-376e-4577-bf51-5ba5b26ca889 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:44.361467 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-c77c9848-376e-4577-bf51-5ba5b26ca889 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:44.369125 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c77c9848-376e-4577-bf51-5ba5b26ca889 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:44.369716 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c77c9848-376e-4577-bf51-5ba5b26ca889 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:44.370152 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c77c9848-376e-4577-bf51-5ba5b26ca889 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:44.370840 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c77c9848-376e-4577-bf51-5ba5b26ca889 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:44.371281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c77c9848-376e-4577-bf51-5ba5b26ca889 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:44.371695 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c77c9848-376e-4577-bf51-5ba5b26ca889 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:44.405600 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-b30e7d92-2d87-45c7-99e3-66434dcd0d64 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:44.413371 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-b30e7d92-2d87-45c7-99e3-66434dcd0d64 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0" status: 200 len: 1293 microversion: 2.1 time: 0.086832 Sep 02 05:30:44.413940 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 449/897] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:44 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:44.432440 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-40e466d6-68ce-4c64-9b8e-9d259bba60f9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1065990506", "imageRef": "f3669111-2e3f-4f39-878f-19d263505eaa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fd2f8a24-ffb3-408a-a457-eed06f87f871"}], "security_groups": [{"name": "tempest-securitygroup--1887278365"}], "key_name": "tempest-keypair-92141164", "user_data": "}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:30:44.563122 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-c77c9848-376e-4577-bf51-5ba5b26ca889 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:44.568809 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.network.neutron [None req-40e466d6-68ce-4c64-9b8e-9d259bba60f9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] validate_networks() for [('fd2f8a24-ffb3-408a-a457-eed06f87f871', None, None, None, None, None)] {{(pid=120448) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 05:30:44.571694 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-c77c9848-376e-4577-bf51-5ba5b26ca889 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1575 microversion: 2.1 time: 0.214735 Sep 02 05:30:44.572268 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 449/898] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:44 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1575 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:44.947663 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-40e466d6-68ce-4c64-9b8e-9d259bba60f9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Flavor limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 05:30:44.948093 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-40e466d6-68ce-4c64-9b8e-9d259bba60f9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Image limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 05:30:44.948603 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-40e466d6-68ce-4c64-9b8e-9d259bba60f9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Flavor pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 05:30:44.949081 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-40e466d6-68ce-4c64-9b8e-9d259bba60f9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Image pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 05:30:44.949756 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-40e466d6-68ce-4c64-9b8e-9d259bba60f9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 05:30:44.964222 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-40e466d6-68ce-4c64-9b8e-9d259bba60f9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:44.965097 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-40e466d6-68ce-4c64-9b8e-9d259bba60f9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:44.965736 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-40e466d6-68ce-4c64-9b8e-9d259bba60f9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:44.966796 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-40e466d6-68ce-4c64-9b8e-9d259bba60f9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:44.967457 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-40e466d6-68ce-4c64-9b8e-9d259bba60f9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:44.968062 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-40e466d6-68ce-4c64-9b8e-9d259bba60f9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:44.981216 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:30:44.991217 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-40e466d6-68ce-4c64-9b8e-9d259bba60f9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Getting quotas for project 11ca1d5cfab24589b53707dea9790e26. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:30:44.995354 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-40e466d6-68ce-4c64-9b8e-9d259bba60f9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Getting quotas for user f47ca04b60554047b0541de359bafd26 and project 11ca1d5cfab24589b53707dea9790e26. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:30:45.007589 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-40e466d6-68ce-4c64-9b8e-9d259bba60f9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Going to run 1 instances... {{(pid=120448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 05:30:45.009828 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-40e466d6-68ce-4c64-9b8e-9d259bba60f9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3669111-2e3f-4f39-878f-19d263505eaa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 05:30:45.056082 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-40e466d6-68ce-4c64-9b8e-9d259bba60f9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.641139 Sep 02 05:30:45.056792 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 450/899] 10.222.0.30 () {62 vars in 1188 bytes} [Fri Sep 2 05:30:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 02 05:30:45.067953 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-002fe445-80dd-45d5-bce0-bdfa42117207 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:45.068667 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-002fe445-80dd-45d5-bce0-bdfa42117207 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:45.129178 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-002fe445-80dd-45d5-bce0-bdfa42117207 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:45.138549 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-002fe445-80dd-45d5-bce0-bdfa42117207 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:45.140171 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-002fe445-80dd-45d5-bce0-bdfa42117207 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:45.141287 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-002fe445-80dd-45d5-bce0-bdfa42117207 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1280 microversion: 2.20 time: 0.077423 Sep 02 05:30:45.141857 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 450/900] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:30:45 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1280 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:30:45.436768 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-fc8938ff-4896-4b09-8cae-e4955663c7fd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:45.437946 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-fc8938ff-4896-4b09-8cae-e4955663c7fd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:45.444322 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fc8938ff-4896-4b09-8cae-e4955663c7fd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:45.444802 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fc8938ff-4896-4b09-8cae-e4955663c7fd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:45.445236 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fc8938ff-4896-4b09-8cae-e4955663c7fd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:45.446003 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fc8938ff-4896-4b09-8cae-e4955663c7fd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:45.446462 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fc8938ff-4896-4b09-8cae-e4955663c7fd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:45.446881 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fc8938ff-4896-4b09-8cae-e4955663c7fd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:45.465644 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:30:45.558480 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-fc8938ff-4896-4b09-8cae-e4955663c7fd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:45.568554 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-fc8938ff-4896-4b09-8cae-e4955663c7fd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0" status: 200 len: 1301 microversion: 2.1 time: 0.137062 Sep 02 05:30:45.580515 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 451/901] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:45 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0 => generated 1301 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:45.600425 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-e519756c-fa55-46e7-a060-5371d5bcb066 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:45.601781 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-e519756c-fa55-46e7-a060-5371d5bcb066 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:45.610208 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e519756c-fa55-46e7-a060-5371d5bcb066 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:45.610940 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e519756c-fa55-46e7-a060-5371d5bcb066 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:45.611717 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e519756c-fa55-46e7-a060-5371d5bcb066 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:45.612474 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e519756c-fa55-46e7-a060-5371d5bcb066 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:45.613404 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e519756c-fa55-46e7-a060-5371d5bcb066 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:45.613826 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e519756c-fa55-46e7-a060-5371d5bcb066 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:45.798240 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e519756c-fa55-46e7-a060-5371d5bcb066 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:45.806909 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-e519756c-fa55-46e7-a060-5371d5bcb066 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1562 microversion: 2.1 time: 0.211912 Sep 02 05:30:45.807702 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 451/902] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:45 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1562 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:46.165217 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-b42c92bf-5a20-4e44-a031-e0abdd462a91 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:46.165832 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-b42c92bf-5a20-4e44-a031-e0abdd462a91 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:46.172109 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b42c92bf-5a20-4e44-a031-e0abdd462a91 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:46.173243 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b42c92bf-5a20-4e44-a031-e0abdd462a91 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:46.173871 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b42c92bf-5a20-4e44-a031-e0abdd462a91 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:46.174731 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b42c92bf-5a20-4e44-a031-e0abdd462a91 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:46.175364 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b42c92bf-5a20-4e44-a031-e0abdd462a91 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:46.175815 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b42c92bf-5a20-4e44-a031-e0abdd462a91 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:46.247892 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-b42c92bf-5a20-4e44-a031-e0abdd462a91 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:46.258335 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-b42c92bf-5a20-4e44-a031-e0abdd462a91 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:46.260058 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-b42c92bf-5a20-4e44-a031-e0abdd462a91 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:46.261312 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-b42c92bf-5a20-4e44-a031-e0abdd462a91 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1332 microversion: 2.20 time: 0.101302 Sep 02 05:30:46.271975 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 452/903] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:30:46 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1332 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:30:46.592071 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-d73d8f3d-a752-4737-b670-8e1320fecdfa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:46.592802 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-d73d8f3d-a752-4737-b670-8e1320fecdfa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:46.614376 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d73d8f3d-a752-4737-b670-8e1320fecdfa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:46.615046 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d73d8f3d-a752-4737-b670-8e1320fecdfa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:46.615431 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d73d8f3d-a752-4737-b670-8e1320fecdfa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:46.616326 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d73d8f3d-a752-4737-b670-8e1320fecdfa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:46.616922 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d73d8f3d-a752-4737-b670-8e1320fecdfa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:46.617354 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d73d8f3d-a752-4737-b670-8e1320fecdfa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:46.887236 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-d73d8f3d-a752-4737-b670-8e1320fecdfa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:46.896634 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-d73d8f3d-a752-4737-b670-8e1320fecdfa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0" status: 200 len: 1366 microversion: 2.1 time: 0.309538 Sep 02 05:30:46.897217 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 452/904] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:46 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0 => generated 1366 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:30:47.258899 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-cbbfdbfc-a6f1-4b1d-8f9a-8828467b13ac req-e6737103-853e-400c-823d-02472172b03d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d783711-2893-40ce-8b8b-800090dd1ef0", "tag": "a9f72ebb-4815-42c7-8ffd-a581daf00288"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:30:47.272566 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-cbbfdbfc-a6f1-4b1d-8f9a-8828467b13ac req-e6737103-853e-400c-823d-02472172b03d service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:47.273174 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-cbbfdbfc-a6f1-4b1d-8f9a-8828467b13ac req-e6737103-853e-400c-823d-02472172b03d service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:47.275180 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-cbbfdbfc-a6f1-4b1d-8f9a-8828467b13ac req-e6737103-853e-400c-823d-02472172b03d service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:47.288741 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-cbbfdbfc-a6f1-4b1d-8f9a-8828467b13ac req-e6737103-853e-400c-823d-02472172b03d service nova] Creating event network-changed:a9f72ebb-4815-42c7-8ffd-a581daf00288 for instance 1d783711-2893-40ce-8b8b-800090dd1ef0 on hv-cinder-85391 Sep 02 05:30:47.289366 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-35f0bb4c-815a-4584-9407-e72be9415825 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:47.290509 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-35f0bb4c-815a-4584-9407-e72be9415825 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:47.294923 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-cbbfdbfc-a6f1-4b1d-8f9a-8828467b13ac req-e6737103-853e-400c-823d-02472172b03d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040224 Sep 02 05:30:47.296139 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 453/905] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:30:47.300232 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-35f0bb4c-815a-4584-9407-e72be9415825 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:47.311081 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-35f0bb4c-815a-4584-9407-e72be9415825 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:47.312095 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-35f0bb4c-815a-4584-9407-e72be9415825 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:47.315463 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-35f0bb4c-815a-4584-9407-e72be9415825 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:47.316036 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-35f0bb4c-815a-4584-9407-e72be9415825 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:47.316581 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-35f0bb4c-815a-4584-9407-e72be9415825 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:47.395490 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-35f0bb4c-815a-4584-9407-e72be9415825 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:47.404504 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-35f0bb4c-815a-4584-9407-e72be9415825 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:47.406033 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-35f0bb4c-815a-4584-9407-e72be9415825 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:47.407334 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-35f0bb4c-815a-4584-9407-e72be9415825 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1338 microversion: 2.20 time: 0.125609 Sep 02 05:30:47.408297 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 453/906] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:30:47 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1338 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:30:47.919003 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-3a9fdd79-f42b-42c5-ac51-26a100c86a37 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:47.919850 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-3a9fdd79-f42b-42c5-ac51-26a100c86a37 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:47.926878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3a9fdd79-f42b-42c5-ac51-26a100c86a37 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:47.927566 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3a9fdd79-f42b-42c5-ac51-26a100c86a37 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:47.928016 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3a9fdd79-f42b-42c5-ac51-26a100c86a37 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:47.928872 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3a9fdd79-f42b-42c5-ac51-26a100c86a37 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:47.929487 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3a9fdd79-f42b-42c5-ac51-26a100c86a37 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:47.930101 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3a9fdd79-f42b-42c5-ac51-26a100c86a37 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:48.147951 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-282dcdb3-4193-4118-861e-50b216fb5e92 req-abfc423e-6ff7-48ee-ace0-92a0d15c7625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d862d87f-85bc-4970-97b5-af0ff1b6ebf8", "tag": "47f28e65-04e5-4573-84d6-9faa45a85dd1"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:30:48.159913 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-282dcdb3-4193-4118-861e-50b216fb5e92 req-abfc423e-6ff7-48ee-ace0-92a0d15c7625 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:48.160437 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-282dcdb3-4193-4118-861e-50b216fb5e92 req-abfc423e-6ff7-48ee-ace0-92a0d15c7625 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:48.161069 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-282dcdb3-4193-4118-861e-50b216fb5e92 req-abfc423e-6ff7-48ee-ace0-92a0d15c7625 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:48.175743 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-282dcdb3-4193-4118-861e-50b216fb5e92 req-abfc423e-6ff7-48ee-ace0-92a0d15c7625 service nova] Creating event network-changed:47f28e65-04e5-4573-84d6-9faa45a85dd1 for instance d862d87f-85bc-4970-97b5-af0ff1b6ebf8 on hv-cinder-85391 Sep 02 05:30:48.181111 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-282dcdb3-4193-4118-861e-50b216fb5e92 req-abfc423e-6ff7-48ee-ace0-92a0d15c7625 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036946 Sep 02 05:30:48.182317 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 454/907] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 05:30:48.318104 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-3a9fdd79-f42b-42c5-ac51-26a100c86a37 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:48.329206 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-3a9fdd79-f42b-42c5-ac51-26a100c86a37 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0" status: 200 len: 1366 microversion: 2.1 time: 0.415012 Sep 02 05:30:48.329976 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 454/908] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:47 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0 => generated 1366 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:48.433383 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5bc31a61-51f4-4143-8d6e-1746c6f450f5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:48.434256 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5bc31a61-51f4-4143-8d6e-1746c6f450f5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:48.441975 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5bc31a61-51f4-4143-8d6e-1746c6f450f5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:48.442458 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5bc31a61-51f4-4143-8d6e-1746c6f450f5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:48.442891 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5bc31a61-51f4-4143-8d6e-1746c6f450f5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:48.443577 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5bc31a61-51f4-4143-8d6e-1746c6f450f5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:48.444051 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5bc31a61-51f4-4143-8d6e-1746c6f450f5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:48.444495 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5bc31a61-51f4-4143-8d6e-1746c6f450f5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:48.574831 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5bc31a61-51f4-4143-8d6e-1746c6f450f5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:48.583345 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5bc31a61-51f4-4143-8d6e-1746c6f450f5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:48.584807 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5bc31a61-51f4-4143-8d6e-1746c6f450f5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:48.585910 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5bc31a61-51f4-4143-8d6e-1746c6f450f5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1406 microversion: 2.20 time: 0.158031 Sep 02 05:30:48.586462 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 455/909] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:30:48 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:30:49.352497 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-c20ef652-dd3e-43e8-857d-6198db1a3c95 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:49.353147 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-c20ef652-dd3e-43e8-857d-6198db1a3c95 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:49.363925 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c20ef652-dd3e-43e8-857d-6198db1a3c95 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:49.364787 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c20ef652-dd3e-43e8-857d-6198db1a3c95 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:49.365222 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c20ef652-dd3e-43e8-857d-6198db1a3c95 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:49.365923 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c20ef652-dd3e-43e8-857d-6198db1a3c95 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:49.366369 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c20ef652-dd3e-43e8-857d-6198db1a3c95 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:49.366796 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c20ef652-dd3e-43e8-857d-6198db1a3c95 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:49.511772 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c20ef652-dd3e-43e8-857d-6198db1a3c95 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:49.519830 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-c20ef652-dd3e-43e8-857d-6198db1a3c95 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0" status: 200 len: 1366 microversion: 2.1 time: 0.171811 Sep 02 05:30:49.520414 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 455/910] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:49 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:49.611833 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-84e13505-b234-4fd8-aad3-d7f3b63fc099 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:49.612703 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-84e13505-b234-4fd8-aad3-d7f3b63fc099 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:49.619799 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-84e13505-b234-4fd8-aad3-d7f3b63fc099 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:49.620335 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-84e13505-b234-4fd8-aad3-d7f3b63fc099 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:49.620779 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-84e13505-b234-4fd8-aad3-d7f3b63fc099 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:49.621469 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-84e13505-b234-4fd8-aad3-d7f3b63fc099 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:49.621923 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-84e13505-b234-4fd8-aad3-d7f3b63fc099 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:49.622356 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-84e13505-b234-4fd8-aad3-d7f3b63fc099 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:49.762760 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-84e13505-b234-4fd8-aad3-d7f3b63fc099 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:49.771409 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-84e13505-b234-4fd8-aad3-d7f3b63fc099 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:49.772897 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-84e13505-b234-4fd8-aad3-d7f3b63fc099 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:49.774046 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-84e13505-b234-4fd8-aad3-d7f3b63fc099 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1406 microversion: 2.20 time: 0.167941 Sep 02 05:30:49.774582 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 456/911] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:30:49 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:30:50.541018 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-e66fe3bd-fd7e-408b-bce1-1fdae636c8f8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:50.541629 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-e66fe3bd-fd7e-408b-bce1-1fdae636c8f8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:50.548780 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e66fe3bd-fd7e-408b-bce1-1fdae636c8f8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:50.549265 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e66fe3bd-fd7e-408b-bce1-1fdae636c8f8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:50.549701 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e66fe3bd-fd7e-408b-bce1-1fdae636c8f8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:50.550386 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e66fe3bd-fd7e-408b-bce1-1fdae636c8f8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:50.550840 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e66fe3bd-fd7e-408b-bce1-1fdae636c8f8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:50.551264 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e66fe3bd-fd7e-408b-bce1-1fdae636c8f8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:50.702976 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-e66fe3bd-fd7e-408b-bce1-1fdae636c8f8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:50.715608 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-e66fe3bd-fd7e-408b-bce1-1fdae636c8f8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0" status: 200 len: 1366 microversion: 2.1 time: 0.178323 Sep 02 05:30:50.718414 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 456/912] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:50 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:50.797298 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-e72c5eb7-1182-4c18-9f86-96ef86b60bf9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:50.797825 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-e72c5eb7-1182-4c18-9f86-96ef86b60bf9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:50.804801 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e72c5eb7-1182-4c18-9f86-96ef86b60bf9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:50.805314 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e72c5eb7-1182-4c18-9f86-96ef86b60bf9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:50.805739 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e72c5eb7-1182-4c18-9f86-96ef86b60bf9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:50.806441 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e72c5eb7-1182-4c18-9f86-96ef86b60bf9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:50.806900 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e72c5eb7-1182-4c18-9f86-96ef86b60bf9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:50.807325 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e72c5eb7-1182-4c18-9f86-96ef86b60bf9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:50.943616 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e72c5eb7-1182-4c18-9f86-96ef86b60bf9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:50.952150 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e72c5eb7-1182-4c18-9f86-96ef86b60bf9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:50.953585 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e72c5eb7-1182-4c18-9f86-96ef86b60bf9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:50.954687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-e72c5eb7-1182-4c18-9f86-96ef86b60bf9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1406 microversion: 2.20 time: 0.161570 Sep 02 05:30:50.955211 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 457/913] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:30:50 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:30:51.739532 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-0269ee26-63d2-4bca-8db1-e5d4bdd4f2c5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:51.740149 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-0269ee26-63d2-4bca-8db1-e5d4bdd4f2c5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:51.746962 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0269ee26-63d2-4bca-8db1-e5d4bdd4f2c5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:51.747444 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0269ee26-63d2-4bca-8db1-e5d4bdd4f2c5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:51.747876 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0269ee26-63d2-4bca-8db1-e5d4bdd4f2c5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:51.748605 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0269ee26-63d2-4bca-8db1-e5d4bdd4f2c5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:51.749059 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0269ee26-63d2-4bca-8db1-e5d4bdd4f2c5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:51.749509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0269ee26-63d2-4bca-8db1-e5d4bdd4f2c5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:51.882005 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-0269ee26-63d2-4bca-8db1-e5d4bdd4f2c5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:51.890459 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-0269ee26-63d2-4bca-8db1-e5d4bdd4f2c5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0" status: 200 len: 1366 microversion: 2.1 time: 0.155302 Sep 02 05:30:51.891031 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 457/914] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:51 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:51.978004 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ffbf9ada-9e90-4e23-9411-efb1f60259e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:51.978662 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-ffbf9ada-9e90-4e23-9411-efb1f60259e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:51.988552 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ffbf9ada-9e90-4e23-9411-efb1f60259e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:51.989027 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ffbf9ada-9e90-4e23-9411-efb1f60259e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:51.989465 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ffbf9ada-9e90-4e23-9411-efb1f60259e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:51.990190 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ffbf9ada-9e90-4e23-9411-efb1f60259e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:51.990636 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ffbf9ada-9e90-4e23-9411-efb1f60259e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:51.991049 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ffbf9ada-9e90-4e23-9411-efb1f60259e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:52.132180 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ffbf9ada-9e90-4e23-9411-efb1f60259e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:52.140781 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ffbf9ada-9e90-4e23-9411-efb1f60259e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:52.142192 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ffbf9ada-9e90-4e23-9411-efb1f60259e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:52.143291 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-ffbf9ada-9e90-4e23-9411-efb1f60259e8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1406 microversion: 2.20 time: 0.169497 Sep 02 05:30:52.143816 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 458/915] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:30:51 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:30:52.912139 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-e2bd9d83-58a9-4ba2-a03c-3455b2e702ad tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:52.912740 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-e2bd9d83-58a9-4ba2-a03c-3455b2e702ad tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:52.920252 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e2bd9d83-58a9-4ba2-a03c-3455b2e702ad tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:52.921044 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e2bd9d83-58a9-4ba2-a03c-3455b2e702ad tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:52.921760 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e2bd9d83-58a9-4ba2-a03c-3455b2e702ad tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:52.922571 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e2bd9d83-58a9-4ba2-a03c-3455b2e702ad tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:52.923262 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e2bd9d83-58a9-4ba2-a03c-3455b2e702ad tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:52.923524 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e2bd9d83-58a9-4ba2-a03c-3455b2e702ad tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:53.141118 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-e2bd9d83-58a9-4ba2-a03c-3455b2e702ad tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:53.149739 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-e2bd9d83-58a9-4ba2-a03c-3455b2e702ad tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0" status: 200 len: 1366 microversion: 2.1 time: 0.242158 Sep 02 05:30:53.150311 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 458/916] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:52 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:53.169449 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5b2afff1-3792-485d-bba9-49c06276b81c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:53.170161 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5b2afff1-3792-485d-bba9-49c06276b81c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:53.177288 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5b2afff1-3792-485d-bba9-49c06276b81c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:53.177862 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5b2afff1-3792-485d-bba9-49c06276b81c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:53.178295 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5b2afff1-3792-485d-bba9-49c06276b81c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:53.178985 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5b2afff1-3792-485d-bba9-49c06276b81c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:53.179433 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5b2afff1-3792-485d-bba9-49c06276b81c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:53.179974 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5b2afff1-3792-485d-bba9-49c06276b81c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:53.199251 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=100 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:30:53.322808 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5b2afff1-3792-485d-bba9-49c06276b81c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:53.331531 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5b2afff1-3792-485d-bba9-49c06276b81c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:53.332983 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5b2afff1-3792-485d-bba9-49c06276b81c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:53.334093 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5b2afff1-3792-485d-bba9-49c06276b81c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1406 microversion: 2.20 time: 0.168741 Sep 02 05:30:53.334672 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 459/917] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:30:53 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:30:54.173345 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-47dddc36-20ff-4a04-a533-fba5d4cad05f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:54.174066 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-47dddc36-20ff-4a04-a533-fba5d4cad05f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:54.181075 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-47dddc36-20ff-4a04-a533-fba5d4cad05f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:54.181621 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-47dddc36-20ff-4a04-a533-fba5d4cad05f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:54.182117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-47dddc36-20ff-4a04-a533-fba5d4cad05f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:54.182811 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-47dddc36-20ff-4a04-a533-fba5d4cad05f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:54.183254 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-47dddc36-20ff-4a04-a533-fba5d4cad05f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:54.183672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-47dddc36-20ff-4a04-a533-fba5d4cad05f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:54.323937 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-47dddc36-20ff-4a04-a533-fba5d4cad05f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:54.337328 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-47dddc36-20ff-4a04-a533-fba5d4cad05f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0" status: 200 len: 1366 microversion: 2.1 time: 0.168293 Sep 02 05:30:54.339682 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 459/918] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:54 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:54.358225 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-54977f48-a2bd-4ef5-9bd8-5a5080c1caa5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:54.358818 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-54977f48-a2bd-4ef5-9bd8-5a5080c1caa5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:54.361489 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:30:54.367630 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-54977f48-a2bd-4ef5-9bd8-5a5080c1caa5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:54.368539 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-54977f48-a2bd-4ef5-9bd8-5a5080c1caa5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:54.368971 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-54977f48-a2bd-4ef5-9bd8-5a5080c1caa5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:54.369665 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-54977f48-a2bd-4ef5-9bd8-5a5080c1caa5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:54.370113 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-54977f48-a2bd-4ef5-9bd8-5a5080c1caa5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:54.370528 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-54977f48-a2bd-4ef5-9bd8-5a5080c1caa5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:54.509644 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-54977f48-a2bd-4ef5-9bd8-5a5080c1caa5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:54.518149 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-54977f48-a2bd-4ef5-9bd8-5a5080c1caa5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:54.519660 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-54977f48-a2bd-4ef5-9bd8-5a5080c1caa5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:54.520811 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-54977f48-a2bd-4ef5-9bd8-5a5080c1caa5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1406 microversion: 2.20 time: 0.167109 Sep 02 05:30:54.521382 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 460/919] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:30:54 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:30:55.362570 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-03389e9a-8cee-4879-8299-358f4ec5ddcd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:55.363605 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-03389e9a-8cee-4879-8299-358f4ec5ddcd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:55.365642 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell0:SELECT=4 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:30:55.366395 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell0:SELECT=18 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:30:55.372764 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-03389e9a-8cee-4879-8299-358f4ec5ddcd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:55.373254 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-03389e9a-8cee-4879-8299-358f4ec5ddcd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:55.373688 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-03389e9a-8cee-4879-8299-358f4ec5ddcd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:55.374389 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-03389e9a-8cee-4879-8299-358f4ec5ddcd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:55.374840 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-03389e9a-8cee-4879-8299-358f4ec5ddcd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:55.375258 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-03389e9a-8cee-4879-8299-358f4ec5ddcd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:55.513316 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-03389e9a-8cee-4879-8299-358f4ec5ddcd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:55.521169 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-03389e9a-8cee-4879-8299-358f4ec5ddcd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0" status: 200 len: 1366 microversion: 2.1 time: 0.162525 Sep 02 05:30:55.522268 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 460/920] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:55 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:55.542832 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-78f0af89-ff94-4dc5-ac4e-d0a5714343c4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:55.543433 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-78f0af89-ff94-4dc5-ac4e-d0a5714343c4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:55.545519 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell0:SELECT=6 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:30:55.551660 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-78f0af89-ff94-4dc5-ac4e-d0a5714343c4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:55.552207 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-78f0af89-ff94-4dc5-ac4e-d0a5714343c4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:55.552670 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-78f0af89-ff94-4dc5-ac4e-d0a5714343c4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:55.553422 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-78f0af89-ff94-4dc5-ac4e-d0a5714343c4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:55.553868 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-78f0af89-ff94-4dc5-ac4e-d0a5714343c4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:55.554311 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-78f0af89-ff94-4dc5-ac4e-d0a5714343c4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:55.685040 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-78f0af89-ff94-4dc5-ac4e-d0a5714343c4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:55.694691 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-78f0af89-ff94-4dc5-ac4e-d0a5714343c4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:55.696323 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-78f0af89-ff94-4dc5-ac4e-d0a5714343c4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:55.697906 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-78f0af89-ff94-4dc5-ac4e-d0a5714343c4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1406 microversion: 2.20 time: 0.158584 Sep 02 05:30:55.698208 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 461/921] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:30:55 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:30:56.456957 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-e1e46383-4bf9-4ad6-b5bf-ea7f0bf9fe49 req-ce726998-dde5-43ae-9a63-d6786fdfe192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d783711-2893-40ce-8b8b-800090dd1ef0", "name": "network-vif-plugged", "status": "completed", "tag": "a9f72ebb-4815-42c7-8ffd-a581daf00288"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:30:56.467832 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-e1e46383-4bf9-4ad6-b5bf-ea7f0bf9fe49 req-ce726998-dde5-43ae-9a63-d6786fdfe192 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:56.468351 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-e1e46383-4bf9-4ad6-b5bf-ea7f0bf9fe49 req-ce726998-dde5-43ae-9a63-d6786fdfe192 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:56.469075 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-e1e46383-4bf9-4ad6-b5bf-ea7f0bf9fe49 req-ce726998-dde5-43ae-9a63-d6786fdfe192 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:56.482388 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-e1e46383-4bf9-4ad6-b5bf-ea7f0bf9fe49 req-ce726998-dde5-43ae-9a63-d6786fdfe192 service nova] Creating event network-vif-plugged:a9f72ebb-4815-42c7-8ffd-a581daf00288 for instance 1d783711-2893-40ce-8b8b-800090dd1ef0 on hv-cinder-85391 Sep 02 05:30:56.488400 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-e1e46383-4bf9-4ad6-b5bf-ea7f0bf9fe49 req-ce726998-dde5-43ae-9a63-d6786fdfe192 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034822 Sep 02 05:30:56.489000 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 461/922] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:30:56.542343 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5f745418-c7fb-4ced-9cd6-907de6d90c84 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:56.543181 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5f745418-c7fb-4ced-9cd6-907de6d90c84 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:56.549927 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5f745418-c7fb-4ced-9cd6-907de6d90c84 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:56.550407 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5f745418-c7fb-4ced-9cd6-907de6d90c84 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:56.550897 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5f745418-c7fb-4ced-9cd6-907de6d90c84 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:56.551585 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5f745418-c7fb-4ced-9cd6-907de6d90c84 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:56.552031 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5f745418-c7fb-4ced-9cd6-907de6d90c84 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:56.552474 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5f745418-c7fb-4ced-9cd6-907de6d90c84 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:56.696769 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5f745418-c7fb-4ced-9cd6-907de6d90c84 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:56.708248 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5f745418-c7fb-4ced-9cd6-907de6d90c84 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0" status: 200 len: 1366 microversion: 2.1 time: 0.169640 Sep 02 05:30:56.708955 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 462/923] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:56 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:56.721615 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-3e3eb659-4f7d-42a4-9be6-e11a3b48d33d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:56.727250 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-3e3eb659-4f7d-42a4-9be6-e11a3b48d33d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:56.739032 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3e3eb659-4f7d-42a4-9be6-e11a3b48d33d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:56.739486 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3e3eb659-4f7d-42a4-9be6-e11a3b48d33d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:56.740350 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3e3eb659-4f7d-42a4-9be6-e11a3b48d33d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:56.742741 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3e3eb659-4f7d-42a4-9be6-e11a3b48d33d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:56.746201 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3e3eb659-4f7d-42a4-9be6-e11a3b48d33d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:56.746823 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3e3eb659-4f7d-42a4-9be6-e11a3b48d33d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:56.938300 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-3e3eb659-4f7d-42a4-9be6-e11a3b48d33d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:56.948661 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-3e3eb659-4f7d-42a4-9be6-e11a3b48d33d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:56.950038 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-3e3eb659-4f7d-42a4-9be6-e11a3b48d33d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:56.951158 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-3e3eb659-4f7d-42a4-9be6-e11a3b48d33d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1406 microversion: 2.20 time: 0.234699 Sep 02 05:30:56.951884 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 462/924] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:30:56 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:30:57.729497 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-e14f3a49-1b2e-4785-8ded-f27800ccf50b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:57.730105 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-e14f3a49-1b2e-4785-8ded-f27800ccf50b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:57.736825 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e14f3a49-1b2e-4785-8ded-f27800ccf50b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:57.737295 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e14f3a49-1b2e-4785-8ded-f27800ccf50b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:57.738062 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e14f3a49-1b2e-4785-8ded-f27800ccf50b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:57.738802 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e14f3a49-1b2e-4785-8ded-f27800ccf50b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:57.739253 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e14f3a49-1b2e-4785-8ded-f27800ccf50b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:57.739679 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e14f3a49-1b2e-4785-8ded-f27800ccf50b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:57.875251 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e14f3a49-1b2e-4785-8ded-f27800ccf50b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:57.883276 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-e14f3a49-1b2e-4785-8ded-f27800ccf50b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0" status: 200 len: 1366 microversion: 2.1 time: 0.157626 Sep 02 05:30:57.883938 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 463/925] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:57 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:57.975400 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-0d18cae7-e8bb-4139-b357-008859e20832 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:57.975944 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-0d18cae7-e8bb-4139-b357-008859e20832 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:57.982994 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0d18cae7-e8bb-4139-b357-008859e20832 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:57.983469 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0d18cae7-e8bb-4139-b357-008859e20832 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:57.983912 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0d18cae7-e8bb-4139-b357-008859e20832 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:57.984670 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0d18cae7-e8bb-4139-b357-008859e20832 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:57.985106 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0d18cae7-e8bb-4139-b357-008859e20832 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:57.985565 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0d18cae7-e8bb-4139-b357-008859e20832 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:58.118548 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-0d18cae7-e8bb-4139-b357-008859e20832 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:58.127131 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-0d18cae7-e8bb-4139-b357-008859e20832 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:58.129597 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-0d18cae7-e8bb-4139-b357-008859e20832 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:58.131312 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-0d18cae7-e8bb-4139-b357-008859e20832 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1406 microversion: 2.20 time: 0.159921 Sep 02 05:30:58.132640 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 463/926] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:30:57 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:30:58.904429 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-bded947b-2858-48a2-b26f-7bcba77e25aa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:58.905065 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-bded947b-2858-48a2-b26f-7bcba77e25aa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:58.911819 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bded947b-2858-48a2-b26f-7bcba77e25aa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:58.912341 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bded947b-2858-48a2-b26f-7bcba77e25aa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:58.912768 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bded947b-2858-48a2-b26f-7bcba77e25aa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:58.913452 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bded947b-2858-48a2-b26f-7bcba77e25aa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:58.913896 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bded947b-2858-48a2-b26f-7bcba77e25aa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:58.914313 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bded947b-2858-48a2-b26f-7bcba77e25aa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:59.049913 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-bded947b-2858-48a2-b26f-7bcba77e25aa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:59.057710 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-bded947b-2858-48a2-b26f-7bcba77e25aa tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0" status: 200 len: 1366 microversion: 2.1 time: 0.157510 Sep 02 05:30:59.058283 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 464/927] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:30:58 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:30:59.154581 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-fe3a8338-8fa1-4a5a-9ddf-c3efc45a466c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:30:59.155185 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-fe3a8338-8fa1-4a5a-9ddf-c3efc45a466c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:30:59.163870 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fe3a8338-8fa1-4a5a-9ddf-c3efc45a466c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:59.164455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fe3a8338-8fa1-4a5a-9ddf-c3efc45a466c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:59.165102 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fe3a8338-8fa1-4a5a-9ddf-c3efc45a466c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:59.166040 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fe3a8338-8fa1-4a5a-9ddf-c3efc45a466c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:30:59.166498 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fe3a8338-8fa1-4a5a-9ddf-c3efc45a466c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:30:59.166923 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fe3a8338-8fa1-4a5a-9ddf-c3efc45a466c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:30:59.312493 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-fe3a8338-8fa1-4a5a-9ddf-c3efc45a466c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:59.320684 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-fe3a8338-8fa1-4a5a-9ddf-c3efc45a466c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:59.322108 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-fe3a8338-8fa1-4a5a-9ddf-c3efc45a466c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:30:59.323829 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-fe3a8338-8fa1-4a5a-9ddf-c3efc45a466c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1406 microversion: 2.20 time: 0.173217 Sep 02 05:30:59.324415 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 464/928] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:30:59 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:31:00.078834 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-afe9a50a-2577-45de-bc17-9649d463bce1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:00.079355 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-afe9a50a-2577-45de-bc17-9649d463bce1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:00.086228 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-afe9a50a-2577-45de-bc17-9649d463bce1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:00.086706 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-afe9a50a-2577-45de-bc17-9649d463bce1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:00.087120 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-afe9a50a-2577-45de-bc17-9649d463bce1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:00.087932 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-afe9a50a-2577-45de-bc17-9649d463bce1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:00.088420 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-afe9a50a-2577-45de-bc17-9649d463bce1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:00.088840 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-afe9a50a-2577-45de-bc17-9649d463bce1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:00.226944 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-afe9a50a-2577-45de-bc17-9649d463bce1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:00.235002 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-afe9a50a-2577-45de-bc17-9649d463bce1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0" status: 200 len: 1555 microversion: 2.1 time: 0.160030 Sep 02 05:31:00.235951 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 465/929] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:00 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:31:00.255989 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-2912c8c4-87ce-4407-9b1d-31b1f4ce8482 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:00.256583 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-2912c8c4-87ce-4407-9b1d-31b1f4ce8482 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:00.262998 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2912c8c4-87ce-4407-9b1d-31b1f4ce8482 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:00.263479 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2912c8c4-87ce-4407-9b1d-31b1f4ce8482 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:00.263913 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2912c8c4-87ce-4407-9b1d-31b1f4ce8482 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:00.264636 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2912c8c4-87ce-4407-9b1d-31b1f4ce8482 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:00.265086 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2912c8c4-87ce-4407-9b1d-31b1f4ce8482 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:00.265524 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2912c8c4-87ce-4407-9b1d-31b1f4ce8482 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:00.341847 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-2912c8c4-87ce-4407-9b1d-31b1f4ce8482 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089768 Sep 02 05:31:00.342589 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 465/930] 10.222.0.30 () {58 vars in 1275 bytes} [Fri Sep 2 05:31:00 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:31:00.346482 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-b9b3985a-493d-416b-994e-65a33b3e13c4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:00.347065 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-b9b3985a-493d-416b-994e-65a33b3e13c4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:00.354177 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b9b3985a-493d-416b-994e-65a33b3e13c4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:00.354673 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b9b3985a-493d-416b-994e-65a33b3e13c4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:00.355145 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b9b3985a-493d-416b-994e-65a33b3e13c4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:00.355914 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b9b3985a-493d-416b-994e-65a33b3e13c4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:00.356392 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b9b3985a-493d-416b-994e-65a33b3e13c4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:00.356834 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b9b3985a-493d-416b-994e-65a33b3e13c4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:00.630500 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-1b553f4b-2308-43d9-9977-4cf61633f59e req-90ea25dc-af20-4686-abc5-1ff1c4ddb991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d862d87f-85bc-4970-97b5-af0ff1b6ebf8", "name": "network-vif-plugged", "status": "completed", "tag": "47f28e65-04e5-4573-84d6-9faa45a85dd1"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:31:00.647635 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-1b553f4b-2308-43d9-9977-4cf61633f59e req-90ea25dc-af20-4686-abc5-1ff1c4ddb991 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:00.648453 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-1b553f4b-2308-43d9-9977-4cf61633f59e req-90ea25dc-af20-4686-abc5-1ff1c4ddb991 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:00.649088 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-1b553f4b-2308-43d9-9977-4cf61633f59e req-90ea25dc-af20-4686-abc5-1ff1c4ddb991 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:00.667179 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-1b553f4b-2308-43d9-9977-4cf61633f59e req-90ea25dc-af20-4686-abc5-1ff1c4ddb991 service nova] Creating event network-vif-plugged:47f28e65-04e5-4573-84d6-9faa45a85dd1 for instance d862d87f-85bc-4970-97b5-af0ff1b6ebf8 on hv-cinder-85391 Sep 02 05:31:00.669383 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-b9b3985a-493d-416b-994e-65a33b3e13c4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:00.673179 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-1b553f4b-2308-43d9-9977-4cf61633f59e req-90ea25dc-af20-4686-abc5-1ff1c4ddb991 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050149 Sep 02 05:31:00.674291 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 466/931] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 05:31:00.677764 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-b9b3985a-493d-416b-994e-65a33b3e13c4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:00.679180 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-b9b3985a-493d-416b-994e-65a33b3e13c4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:00.680498 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-b9b3985a-493d-416b-994e-65a33b3e13c4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1406 microversion: 2.20 time: 0.337857 Sep 02 05:31:00.681309 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 466/932] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:31:00 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1406 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:31:01.489877 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-ad42863c-459c-44f1-9cdb-9ef36e58f629 req-2498bd98-8993-4347-841d-2ea7afd4f3ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d783711-2893-40ce-8b8b-800090dd1ef0", "tag": "a9f72ebb-4815-42c7-8ffd-a581daf00288"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:31:01.500377 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-ad42863c-459c-44f1-9cdb-9ef36e58f629 req-2498bd98-8993-4347-841d-2ea7afd4f3ec service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:01.500924 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-ad42863c-459c-44f1-9cdb-9ef36e58f629 req-2498bd98-8993-4347-841d-2ea7afd4f3ec service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:01.501349 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-ad42863c-459c-44f1-9cdb-9ef36e58f629 req-2498bd98-8993-4347-841d-2ea7afd4f3ec service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:01.512286 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-ad42863c-459c-44f1-9cdb-9ef36e58f629 req-2498bd98-8993-4347-841d-2ea7afd4f3ec service nova] Creating event network-changed:a9f72ebb-4815-42c7-8ffd-a581daf00288 for instance 1d783711-2893-40ce-8b8b-800090dd1ef0 on hv-cinder-85391 Sep 02 05:31:01.517315 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-ad42863c-459c-44f1-9cdb-9ef36e58f629 req-2498bd98-8993-4347-841d-2ea7afd4f3ec service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032630 Sep 02 05:31:01.518399 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 467/933] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:31:01.702973 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-05a3165d-2b59-4f37-b176-c1a4a7c90b13 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:01.703579 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-05a3165d-2b59-4f37-b176-c1a4a7c90b13 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:01.712156 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-05a3165d-2b59-4f37-b176-c1a4a7c90b13 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:01.712844 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-05a3165d-2b59-4f37-b176-c1a4a7c90b13 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:01.713275 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-05a3165d-2b59-4f37-b176-c1a4a7c90b13 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:01.714139 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-05a3165d-2b59-4f37-b176-c1a4a7c90b13 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:01.714589 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-05a3165d-2b59-4f37-b176-c1a4a7c90b13 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:01.715173 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-05a3165d-2b59-4f37-b176-c1a4a7c90b13 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:01.854545 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-05a3165d-2b59-4f37-b176-c1a4a7c90b13 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:01.863635 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-05a3165d-2b59-4f37-b176-c1a4a7c90b13 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:01.865370 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-05a3165d-2b59-4f37-b176-c1a4a7c90b13 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:01.866693 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-05a3165d-2b59-4f37-b176-c1a4a7c90b13 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1406 microversion: 2.20 time: 0.167608 Sep 02 05:31:01.867435 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 467/934] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:31:01 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:31:02.895295 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-460d8c2b-3f42-4d3f-8feb-0402c26f17ef tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:02.896019 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-460d8c2b-3f42-4d3f-8feb-0402c26f17ef tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:02.902903 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-460d8c2b-3f42-4d3f-8feb-0402c26f17ef tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:02.903401 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-460d8c2b-3f42-4d3f-8feb-0402c26f17ef tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:02.903850 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-460d8c2b-3f42-4d3f-8feb-0402c26f17ef tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:02.904600 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-460d8c2b-3f42-4d3f-8feb-0402c26f17ef tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:02.905050 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-460d8c2b-3f42-4d3f-8feb-0402c26f17ef tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:02.905509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-460d8c2b-3f42-4d3f-8feb-0402c26f17ef tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:03.039390 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-460d8c2b-3f42-4d3f-8feb-0402c26f17ef tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:03.051461 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-460d8c2b-3f42-4d3f-8feb-0402c26f17ef tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:03.052930 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-460d8c2b-3f42-4d3f-8feb-0402c26f17ef tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:03.054058 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-460d8c2b-3f42-4d3f-8feb-0402c26f17ef tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1406 microversion: 2.20 time: 0.166260 Sep 02 05:31:03.054601 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 468/935] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:31:02 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:31:04.080741 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-04749017-0fe8-47a0-a304-2a5ef3c11069 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:04.081585 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-04749017-0fe8-47a0-a304-2a5ef3c11069 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:04.092564 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-04749017-0fe8-47a0-a304-2a5ef3c11069 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:04.093835 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-04749017-0fe8-47a0-a304-2a5ef3c11069 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:04.094549 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-04749017-0fe8-47a0-a304-2a5ef3c11069 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:04.095667 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-04749017-0fe8-47a0-a304-2a5ef3c11069 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:04.096481 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-04749017-0fe8-47a0-a304-2a5ef3c11069 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:04.097370 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-04749017-0fe8-47a0-a304-2a5ef3c11069 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:04.237469 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-04749017-0fe8-47a0-a304-2a5ef3c11069 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:04.245987 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-04749017-0fe8-47a0-a304-2a5ef3c11069 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:04.247419 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-04749017-0fe8-47a0-a304-2a5ef3c11069 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:04.248621 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-04749017-0fe8-47a0-a304-2a5ef3c11069 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1597 microversion: 2.20 time: 0.174603 Sep 02 05:31:04.249174 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 468/936] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:31:04 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1597 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:31:04.272219 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-40fd279c-dcae-4367-aa92-966fc6310e5e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:04.272773 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-40fd279c-dcae-4367-aa92-966fc6310e5e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:04.279369 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-40fd279c-dcae-4367-aa92-966fc6310e5e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:04.279842 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-40fd279c-dcae-4367-aa92-966fc6310e5e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:04.280307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-40fd279c-dcae-4367-aa92-966fc6310e5e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:04.280977 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-40fd279c-dcae-4367-aa92-966fc6310e5e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:04.281419 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-40fd279c-dcae-4367-aa92-966fc6310e5e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:04.281834 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-40fd279c-dcae-4367-aa92-966fc6310e5e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:04.361133 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-40fd279c-dcae-4367-aa92-966fc6310e5e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092420 Sep 02 05:31:04.362057 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 469/937] 10.222.0.30 () {60 vars in 1316 bytes} [Fri Sep 2 05:31:04 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 05:31:05.552425 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-2d7b71ac-d084-4ba0-8b76-c8a04e9f02fa req-a2c174fa-7f53-497f-9fc7-019e59ecfa43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d862d87f-85bc-4970-97b5-af0ff1b6ebf8", "tag": "47f28e65-04e5-4573-84d6-9faa45a85dd1"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:31:05.562312 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-2d7b71ac-d084-4ba0-8b76-c8a04e9f02fa req-a2c174fa-7f53-497f-9fc7-019e59ecfa43 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:05.562782 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-2d7b71ac-d084-4ba0-8b76-c8a04e9f02fa req-a2c174fa-7f53-497f-9fc7-019e59ecfa43 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:05.563202 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-2d7b71ac-d084-4ba0-8b76-c8a04e9f02fa req-a2c174fa-7f53-497f-9fc7-019e59ecfa43 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:05.574815 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-2d7b71ac-d084-4ba0-8b76-c8a04e9f02fa req-a2c174fa-7f53-497f-9fc7-019e59ecfa43 service nova] Creating event network-changed:47f28e65-04e5-4573-84d6-9faa45a85dd1 for instance d862d87f-85bc-4970-97b5-af0ff1b6ebf8 on hv-cinder-85391 Sep 02 05:31:05.580664 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-2d7b71ac-d084-4ba0-8b76-c8a04e9f02fa req-a2c174fa-7f53-497f-9fc7-019e59ecfa43 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031781 Sep 02 05:31:05.581338 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 469/938] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:31:21.546243 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:31:21.547412 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=90 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:31:21.724834 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-b16b9c41-5753-4b9c-8d23-3ba5414ce598 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:21.725390 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-b16b9c41-5753-4b9c-8d23-3ba5414ce598 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:21.731513 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b16b9c41-5753-4b9c-8d23-3ba5414ce598 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:21.732004 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b16b9c41-5753-4b9c-8d23-3ba5414ce598 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:21.732468 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b16b9c41-5753-4b9c-8d23-3ba5414ce598 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:21.733236 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b16b9c41-5753-4b9c-8d23-3ba5414ce598 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:21.733679 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b16b9c41-5753-4b9c-8d23-3ba5414ce598 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:21.734091 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b16b9c41-5753-4b9c-8d23-3ba5414ce598 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:21.813784 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.objects.instance [None req-b16b9c41-5753-4b9c-8d23-3ba5414ce598 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lazy-loading 'services' on Instance uuid 387fc985-a99f-4805-ab55-641d3fe7cc27 {{(pid=120448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:31:21.890402 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-b16b9c41-5753-4b9c-8d23-3ba5414ce598 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "DELETE /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27/os-volume_attachments/a506e234-2189-496e-8270-511dbbb1908f" status: 202 len: 0 microversion: 2.1 time: 0.346796 Sep 02 05:31:21.891330 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 470/939] 10.222.0.30 () {58 vars in 1416 bytes} [Fri Sep 2 05:31:21 2022] DELETE /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27/os-volume_attachments/a506e234-2189-496e-8270-511dbbb1908f => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:31:24.084359 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_api:SELECT=19 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:31:24.085163 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=58 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:31:24.090309 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-59ca41b6-c068-4456-9566-009cb13f79d7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:31:24.100207 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-59ca41b6-c068-4456-9566-009cb13f79d7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:24.100890 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-59ca41b6-c068-4456-9566-009cb13f79d7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:24.101540 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-59ca41b6-c068-4456-9566-009cb13f79d7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:24.164486 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-59ca41b6-c068-4456-9566-009cb13f79d7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Going to try to stop instance {{(pid=120449) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 02 05:31:24.210913 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-59ca41b6-c068-4456-9566-009cb13f79d7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "POST /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27/action" status: 202 len: 0 microversion: 2.1 time: 0.129061 Sep 02 05:31:24.211592 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 470/940] 10.222.0.30 () {60 vars in 1278 bytes} [Fri Sep 2 05:31:24 2022] POST /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:31:24.220647 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-529837a5-c4be-444d-8850-3e635c86b196 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:24.221934 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-529837a5-c4be-444d-8850-3e635c86b196 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:24.230513 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-529837a5-c4be-444d-8850-3e635c86b196 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:24.231269 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-529837a5-c4be-444d-8850-3e635c86b196 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:24.231710 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-529837a5-c4be-444d-8850-3e635c86b196 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:24.232592 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-529837a5-c4be-444d-8850-3e635c86b196 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:24.233056 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-529837a5-c4be-444d-8850-3e635c86b196 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:24.233481 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-529837a5-c4be-444d-8850-3e635c86b196 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:24.385794 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-529837a5-c4be-444d-8850-3e635c86b196 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:24.393983 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-529837a5-c4be-444d-8850-3e635c86b196 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1677 microversion: 2.1 time: 0.177881 Sep 02 05:31:24.394555 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 471/941] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:24 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:31:25.421226 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-9fa526d2-7fda-4570-b2bd-6428a630910d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:25.424529 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-9fa526d2-7fda-4570-b2bd-6428a630910d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:25.429303 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9fa526d2-7fda-4570-b2bd-6428a630910d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:25.429791 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9fa526d2-7fda-4570-b2bd-6428a630910d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:25.430255 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9fa526d2-7fda-4570-b2bd-6428a630910d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:25.430971 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9fa526d2-7fda-4570-b2bd-6428a630910d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:25.431422 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9fa526d2-7fda-4570-b2bd-6428a630910d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:25.431874 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9fa526d2-7fda-4570-b2bd-6428a630910d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:25.576234 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-9fa526d2-7fda-4570-b2bd-6428a630910d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:25.585704 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-9fa526d2-7fda-4570-b2bd-6428a630910d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1677 microversion: 2.1 time: 0.172370 Sep 02 05:31:25.586285 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 471/942] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:25 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:31:26.609193 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-eb997edb-ba78-44be-baa9-9d6eb18e2832 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:26.609757 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-eb997edb-ba78-44be-baa9-9d6eb18e2832 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:26.616996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eb997edb-ba78-44be-baa9-9d6eb18e2832 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:26.617482 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eb997edb-ba78-44be-baa9-9d6eb18e2832 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:26.617916 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eb997edb-ba78-44be-baa9-9d6eb18e2832 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:26.618695 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eb997edb-ba78-44be-baa9-9d6eb18e2832 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:26.619138 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eb997edb-ba78-44be-baa9-9d6eb18e2832 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:26.619584 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-eb997edb-ba78-44be-baa9-9d6eb18e2832 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:26.756534 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-eb997edb-ba78-44be-baa9-9d6eb18e2832 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:26.764280 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-eb997edb-ba78-44be-baa9-9d6eb18e2832 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1677 microversion: 2.1 time: 0.158980 Sep 02 05:31:26.764852 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 472/943] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:26 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:31:27.789254 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-16c46aad-7128-41df-9f68-f0b536d257e7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:27.790276 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-16c46aad-7128-41df-9f68-f0b536d257e7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:27.800942 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-16c46aad-7128-41df-9f68-f0b536d257e7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:27.801428 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-16c46aad-7128-41df-9f68-f0b536d257e7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:27.801857 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-16c46aad-7128-41df-9f68-f0b536d257e7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:27.802538 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-16c46aad-7128-41df-9f68-f0b536d257e7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:27.802984 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-16c46aad-7128-41df-9f68-f0b536d257e7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:27.803401 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-16c46aad-7128-41df-9f68-f0b536d257e7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:27.948375 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-16c46aad-7128-41df-9f68-f0b536d257e7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:27.956462 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-16c46aad-7128-41df-9f68-f0b536d257e7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1677 microversion: 2.1 time: 0.173711 Sep 02 05:31:27.957035 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 472/944] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:27 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:31:28.981930 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-83592df2-19dc-4584-a00c-665d7bdee5ca tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:28.982830 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-83592df2-19dc-4584-a00c-665d7bdee5ca tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:28.993793 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-83592df2-19dc-4584-a00c-665d7bdee5ca tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:28.994547 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-83592df2-19dc-4584-a00c-665d7bdee5ca tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:28.995257 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-83592df2-19dc-4584-a00c-665d7bdee5ca tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:28.996426 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-83592df2-19dc-4584-a00c-665d7bdee5ca tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:28.997174 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-83592df2-19dc-4584-a00c-665d7bdee5ca tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:28.997877 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-83592df2-19dc-4584-a00c-665d7bdee5ca tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:29.134531 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-83592df2-19dc-4584-a00c-665d7bdee5ca tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:29.144751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-83592df2-19dc-4584-a00c-665d7bdee5ca tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1677 microversion: 2.1 time: 0.169499 Sep 02 05:31:29.145315 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 473/945] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:28 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:31:30.171183 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-51b88224-1af7-47ab-ac61-43d955bb669a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:30.172161 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-51b88224-1af7-47ab-ac61-43d955bb669a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:30.179677 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-51b88224-1af7-47ab-ac61-43d955bb669a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:30.180224 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-51b88224-1af7-47ab-ac61-43d955bb669a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:30.180659 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-51b88224-1af7-47ab-ac61-43d955bb669a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:30.181351 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-51b88224-1af7-47ab-ac61-43d955bb669a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:30.181812 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-51b88224-1af7-47ab-ac61-43d955bb669a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:30.182234 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-51b88224-1af7-47ab-ac61-43d955bb669a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:30.476378 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-51b88224-1af7-47ab-ac61-43d955bb669a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:30.488829 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-51b88224-1af7-47ab-ac61-43d955bb669a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1677 microversion: 2.1 time: 0.324193 Sep 02 05:31:30.489685 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 473/946] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:30 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1677 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:31:31.519062 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-5a1acb21-be2c-4ab0-816e-c7798aa5dcd4 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:31.520190 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-5a1acb21-be2c-4ab0-816e-c7798aa5dcd4 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:31.531130 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5a1acb21-be2c-4ab0-816e-c7798aa5dcd4 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:31.531895 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5a1acb21-be2c-4ab0-816e-c7798aa5dcd4 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:31.532679 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5a1acb21-be2c-4ab0-816e-c7798aa5dcd4 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:31.533822 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5a1acb21-be2c-4ab0-816e-c7798aa5dcd4 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:31.534575 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5a1acb21-be2c-4ab0-816e-c7798aa5dcd4 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:31.535279 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5a1acb21-be2c-4ab0-816e-c7798aa5dcd4 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:31.670926 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-5a1acb21-be2c-4ab0-816e-c7798aa5dcd4 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:31.679542 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-5a1acb21-be2c-4ab0-816e-c7798aa5dcd4 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1677 microversion: 2.1 time: 0.167173 Sep 02 05:31:31.680141 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 474/947] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:31 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:31:32.701443 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-e50733ea-3fe0-4ba3-9205-532b772b87cc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:32.702152 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-e50733ea-3fe0-4ba3-9205-532b772b87cc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:32.712309 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e50733ea-3fe0-4ba3-9205-532b772b87cc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:32.712961 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e50733ea-3fe0-4ba3-9205-532b772b87cc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:32.713577 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e50733ea-3fe0-4ba3-9205-532b772b87cc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:32.714617 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e50733ea-3fe0-4ba3-9205-532b772b87cc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:32.715184 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e50733ea-3fe0-4ba3-9205-532b772b87cc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:32.715635 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e50733ea-3fe0-4ba3-9205-532b772b87cc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:32.855972 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e50733ea-3fe0-4ba3-9205-532b772b87cc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:32.864498 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-e50733ea-3fe0-4ba3-9205-532b772b87cc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1677 microversion: 2.1 time: 0.167093 Sep 02 05:31:32.865062 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 474/948] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:32 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:31:33.885932 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-74ffaf88-b62c-4db0-a3d8-2de437403375 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:33.886556 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-74ffaf88-b62c-4db0-a3d8-2de437403375 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:33.893753 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-74ffaf88-b62c-4db0-a3d8-2de437403375 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:33.894230 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-74ffaf88-b62c-4db0-a3d8-2de437403375 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:33.894657 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-74ffaf88-b62c-4db0-a3d8-2de437403375 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:33.895467 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-74ffaf88-b62c-4db0-a3d8-2de437403375 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:33.895944 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-74ffaf88-b62c-4db0-a3d8-2de437403375 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:33.896404 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-74ffaf88-b62c-4db0-a3d8-2de437403375 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:34.032956 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-74ffaf88-b62c-4db0-a3d8-2de437403375 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:34.040768 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-74ffaf88-b62c-4db0-a3d8-2de437403375 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1677 microversion: 2.1 time: 0.158867 Sep 02 05:31:34.041352 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 475/949] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:33 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:31:35.068980 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-c66777d8-f7c9-4c79-adbf-426cf490604d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:35.069878 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-c66777d8-f7c9-4c79-adbf-426cf490604d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:35.081034 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c66777d8-f7c9-4c79-adbf-426cf490604d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:35.081850 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c66777d8-f7c9-4c79-adbf-426cf490604d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:35.082577 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c66777d8-f7c9-4c79-adbf-426cf490604d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:35.083734 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c66777d8-f7c9-4c79-adbf-426cf490604d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:35.084189 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c66777d8-f7c9-4c79-adbf-426cf490604d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:35.084641 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c66777d8-f7c9-4c79-adbf-426cf490604d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:35.235492 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-c66777d8-f7c9-4c79-adbf-426cf490604d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:35.244410 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-c66777d8-f7c9-4c79-adbf-426cf490604d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1677 microversion: 2.1 time: 0.184089 Sep 02 05:31:35.244978 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 475/950] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:35 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1677 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:31:36.277311 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-27d1030c-8b7b-4176-a823-ebf7440135d3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:36.278298 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-27d1030c-8b7b-4176-a823-ebf7440135d3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:36.288818 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-27d1030c-8b7b-4176-a823-ebf7440135d3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:36.289310 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-27d1030c-8b7b-4176-a823-ebf7440135d3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:36.289744 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-27d1030c-8b7b-4176-a823-ebf7440135d3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:36.290429 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-27d1030c-8b7b-4176-a823-ebf7440135d3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:36.290881 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-27d1030c-8b7b-4176-a823-ebf7440135d3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:36.291304 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-27d1030c-8b7b-4176-a823-ebf7440135d3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:36.421661 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-27d1030c-8b7b-4176-a823-ebf7440135d3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:36.433652 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-27d1030c-8b7b-4176-a823-ebf7440135d3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1677 microversion: 2.1 time: 0.162742 Sep 02 05:31:36.434457 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 476/951] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:36 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:31:37.463277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-6cd5c877-58b6-4ea6-ad62-199890b07c29 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:37.464308 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-6cd5c877-58b6-4ea6-ad62-199890b07c29 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:37.475220 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6cd5c877-58b6-4ea6-ad62-199890b07c29 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:37.476022 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6cd5c877-58b6-4ea6-ad62-199890b07c29 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:37.476844 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6cd5c877-58b6-4ea6-ad62-199890b07c29 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:37.477924 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6cd5c877-58b6-4ea6-ad62-199890b07c29 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:37.478692 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6cd5c877-58b6-4ea6-ad62-199890b07c29 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:37.479391 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6cd5c877-58b6-4ea6-ad62-199890b07c29 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:37.620584 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-6cd5c877-58b6-4ea6-ad62-199890b07c29 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:37.628655 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-6cd5c877-58b6-4ea6-ad62-199890b07c29 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1677 microversion: 2.1 time: 0.171872 Sep 02 05:31:37.629213 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 476/952] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:37 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:31:38.660265 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-57dbdf1c-b47c-4d85-ba0d-88057b2fafb6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:38.662521 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-57dbdf1c-b47c-4d85-ba0d-88057b2fafb6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:38.668256 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-57dbdf1c-b47c-4d85-ba0d-88057b2fafb6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:38.668745 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-57dbdf1c-b47c-4d85-ba0d-88057b2fafb6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:38.669347 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-57dbdf1c-b47c-4d85-ba0d-88057b2fafb6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:38.670128 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-57dbdf1c-b47c-4d85-ba0d-88057b2fafb6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:38.670580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-57dbdf1c-b47c-4d85-ba0d-88057b2fafb6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:38.671008 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-57dbdf1c-b47c-4d85-ba0d-88057b2fafb6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:38.812549 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-57dbdf1c-b47c-4d85-ba0d-88057b2fafb6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:38.820621 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-57dbdf1c-b47c-4d85-ba0d-88057b2fafb6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1677 microversion: 2.1 time: 0.166802 Sep 02 05:31:38.821199 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 477/953] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:38 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:31:39.842606 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ff080674-baae-42d2-97b4-579eafeb46b2 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:39.843221 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-ff080674-baae-42d2-97b4-579eafeb46b2 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:39.850099 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ff080674-baae-42d2-97b4-579eafeb46b2 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:39.850582 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ff080674-baae-42d2-97b4-579eafeb46b2 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:39.851024 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ff080674-baae-42d2-97b4-579eafeb46b2 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:39.851746 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ff080674-baae-42d2-97b4-579eafeb46b2 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:39.852230 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ff080674-baae-42d2-97b4-579eafeb46b2 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:39.852651 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ff080674-baae-42d2-97b4-579eafeb46b2 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:39.981723 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ff080674-baae-42d2-97b4-579eafeb46b2 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:39.994699 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-ff080674-baae-42d2-97b4-579eafeb46b2 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1654 microversion: 2.1 time: 0.155713 Sep 02 05:31:39.995529 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 477/954] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:39 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1654 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:31:40.015789 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-6339330c-7f19-4ead-a3da-8075584ae3a8 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:31:40.022512 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6339330c-7f19-4ead-a3da-8075584ae3a8 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:40.022989 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6339330c-7f19-4ead-a3da-8075584ae3a8 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:40.023420 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6339330c-7f19-4ead-a3da-8075584ae3a8 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:40.045323 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-6339330c-7f19-4ead-a3da-8075584ae3a8 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Going to try to start instance {{(pid=120448) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 02 05:31:40.103349 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-6339330c-7f19-4ead-a3da-8075584ae3a8 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "POST /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27/action" status: 202 len: 0 microversion: 2.1 time: 0.091431 Sep 02 05:31:40.103955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 478/955] 10.222.0.30 () {60 vars in 1278 bytes} [Fri Sep 2 05:31:40 2022] POST /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:31:40.115272 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-c290f49d-8363-4096-88d9-2779b47868a3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:40.116359 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-c290f49d-8363-4096-88d9-2779b47868a3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:40.123395 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c290f49d-8363-4096-88d9-2779b47868a3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:40.123898 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c290f49d-8363-4096-88d9-2779b47868a3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:40.124385 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c290f49d-8363-4096-88d9-2779b47868a3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:40.125231 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c290f49d-8363-4096-88d9-2779b47868a3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:40.125806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c290f49d-8363-4096-88d9-2779b47868a3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:40.126229 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c290f49d-8363-4096-88d9-2779b47868a3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:40.269272 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-c290f49d-8363-4096-88d9-2779b47868a3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:40.277181 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-c290f49d-8363-4096-88d9-2779b47868a3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1663 microversion: 2.1 time: 0.168165 Sep 02 05:31:40.277738 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 478/956] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:40 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1663 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:31:40.486294 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-4bebc065-ec1a-4a66-a96d-aaafd0642ae9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:40.486832 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-4bebc065-ec1a-4a66-a96d-aaafd0642ae9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:40.493667 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4bebc065-ec1a-4a66-a96d-aaafd0642ae9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:40.494133 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4bebc065-ec1a-4a66-a96d-aaafd0642ae9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:40.494572 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4bebc065-ec1a-4a66-a96d-aaafd0642ae9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:40.495247 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4bebc065-ec1a-4a66-a96d-aaafd0642ae9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:40.495691 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4bebc065-ec1a-4a66-a96d-aaafd0642ae9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:40.496105 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4bebc065-ec1a-4a66-a96d-aaafd0642ae9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:40.577996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.objects.instance [None req-4bebc065-ec1a-4a66-a96d-aaafd0642ae9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lazy-loading 'services' on Instance uuid dc1683c4-1646-485d-99de-4b1591af0455 {{(pid=120448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:31:40.650069 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-4bebc065-ec1a-4a66-a96d-aaafd0642ae9 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455/os-volume_attachments/3f0274e3-5836-4d94-b281-31268626f7da" status: 202 len: 0 microversion: 2.1 time: 0.167936 Sep 02 05:31:40.650662 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 479/957] 10.222.0.30 () {58 vars in 1416 bytes} [Fri Sep 2 05:31:40 2022] DELETE /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455/os-volume_attachments/3f0274e3-5836-4d94-b281-31268626f7da => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:31:40.659344 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-b2a6876b-e714-48ce-92f9-945c09b878ba tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:40.661859 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-b2a6876b-e714-48ce-92f9-945c09b878ba tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:40.668991 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b2a6876b-e714-48ce-92f9-945c09b878ba tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:40.669455 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b2a6876b-e714-48ce-92f9-945c09b878ba tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:40.670218 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b2a6876b-e714-48ce-92f9-945c09b878ba tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:40.671281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b2a6876b-e714-48ce-92f9-945c09b878ba tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:40.671904 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b2a6876b-e714-48ce-92f9-945c09b878ba tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:40.672365 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b2a6876b-e714-48ce-92f9-945c09b878ba tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:40.704486 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-b2a6876b-e714-48ce-92f9-945c09b878ba tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049090 Sep 02 05:31:40.709242 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 479/958] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Sep 2 05:31:40 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:31:41.304282 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-ebd8bd86-8365-4e8b-843c-5a5a7b80a0cf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:41.305025 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-ebd8bd86-8365-4e8b-843c-5a5a7b80a0cf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:41.311872 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ebd8bd86-8365-4e8b-843c-5a5a7b80a0cf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:41.312386 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ebd8bd86-8365-4e8b-843c-5a5a7b80a0cf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:41.312926 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ebd8bd86-8365-4e8b-843c-5a5a7b80a0cf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:41.313660 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ebd8bd86-8365-4e8b-843c-5a5a7b80a0cf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:41.314116 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ebd8bd86-8365-4e8b-843c-5a5a7b80a0cf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:41.314543 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ebd8bd86-8365-4e8b-843c-5a5a7b80a0cf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:41.447629 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-ebd8bd86-8365-4e8b-843c-5a5a7b80a0cf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:41.455481 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-ebd8bd86-8365-4e8b-843c-5a5a7b80a0cf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1663 microversion: 2.1 time: 0.159021 Sep 02 05:31:41.456053 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 480/959] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:41 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1663 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:31:41.720547 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-811f8086-8d93-4af0-95c4-2cc1b4ce9d14 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:41.723339 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-811f8086-8d93-4af0-95c4-2cc1b4ce9d14 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:41.731474 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-811f8086-8d93-4af0-95c4-2cc1b4ce9d14 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:41.731982 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-811f8086-8d93-4af0-95c4-2cc1b4ce9d14 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:41.732452 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-811f8086-8d93-4af0-95c4-2cc1b4ce9d14 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:41.733141 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-811f8086-8d93-4af0-95c4-2cc1b4ce9d14 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:41.733621 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-811f8086-8d93-4af0-95c4-2cc1b4ce9d14 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:41.734055 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-811f8086-8d93-4af0-95c4-2cc1b4ce9d14 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:41.766487 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-811f8086-8d93-4af0-95c4-2cc1b4ce9d14 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051822 Sep 02 05:31:41.767067 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 480/960] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Sep 2 05:31:41 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:31:42.478224 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-e92f40dc-3f22-4851-a480-f30bade53a54 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:42.478878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-e92f40dc-3f22-4851-a480-f30bade53a54 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:42.488585 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e92f40dc-3f22-4851-a480-f30bade53a54 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:42.489079 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e92f40dc-3f22-4851-a480-f30bade53a54 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:42.489565 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e92f40dc-3f22-4851-a480-f30bade53a54 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:42.490515 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e92f40dc-3f22-4851-a480-f30bade53a54 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:42.490976 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e92f40dc-3f22-4851-a480-f30bade53a54 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:42.491391 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e92f40dc-3f22-4851-a480-f30bade53a54 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:42.625226 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-e92f40dc-3f22-4851-a480-f30bade53a54 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:42.633009 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-e92f40dc-3f22-4851-a480-f30bade53a54 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1663 microversion: 2.1 time: 0.159220 Sep 02 05:31:42.633559 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 481/961] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:42 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1663 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:31:42.781337 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-46f0dcf6-f97b-4e7a-a156-cc19faee14cb tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:42.784244 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-46f0dcf6-f97b-4e7a-a156-cc19faee14cb tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:42.792922 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-46f0dcf6-f97b-4e7a-a156-cc19faee14cb tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:42.793406 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-46f0dcf6-f97b-4e7a-a156-cc19faee14cb tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:42.793843 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-46f0dcf6-f97b-4e7a-a156-cc19faee14cb tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:42.794529 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-46f0dcf6-f97b-4e7a-a156-cc19faee14cb tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:42.794984 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-46f0dcf6-f97b-4e7a-a156-cc19faee14cb tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:42.795402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-46f0dcf6-f97b-4e7a-a156-cc19faee14cb tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:42.824862 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-46f0dcf6-f97b-4e7a-a156-cc19faee14cb tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049456 Sep 02 05:31:42.825408 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 481/962] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Sep 2 05:31:42 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 05:31:42.905993 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-3b813a0c-fb1b-4c80-b873-05d29ed5960e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:42.906489 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-3b813a0c-fb1b-4c80-b873-05d29ed5960e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:42.912601 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3b813a0c-fb1b-4c80-b873-05d29ed5960e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:42.913073 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3b813a0c-fb1b-4c80-b873-05d29ed5960e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:42.913551 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3b813a0c-fb1b-4c80-b873-05d29ed5960e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:42.914636 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3b813a0c-fb1b-4c80-b873-05d29ed5960e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:42.915445 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3b813a0c-fb1b-4c80-b873-05d29ed5960e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:42.916770 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3b813a0c-fb1b-4c80-b873-05d29ed5960e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:42.945365 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-3b813a0c-fb1b-4c80-b873-05d29ed5960e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Going to try to terminate instance {{(pid=120448) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 05:31:42.992795 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:31:43.028315 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-3b813a0c-fb1b-4c80-b873-05d29ed5960e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 204 len: 0 microversion: 2.1 time: 0.126141 Sep 02 05:31:43.030796 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 482/963] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Sep 2 05:31:42 2022] DELETE /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 05:31:43.039870 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-512b8d21-bbe1-49b8-8fd7-201ee250e310 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:43.040781 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-512b8d21-bbe1-49b8-8fd7-201ee250e310 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:43.046984 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-512b8d21-bbe1-49b8-8fd7-201ee250e310 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:43.047737 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-512b8d21-bbe1-49b8-8fd7-201ee250e310 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:43.048431 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-512b8d21-bbe1-49b8-8fd7-201ee250e310 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:43.049335 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-512b8d21-bbe1-49b8-8fd7-201ee250e310 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:43.049953 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-512b8d21-bbe1-49b8-8fd7-201ee250e310 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:43.050540 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-512b8d21-bbe1-49b8-8fd7-201ee250e310 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:43.196447 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-512b8d21-bbe1-49b8-8fd7-201ee250e310 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:43.204846 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-512b8d21-bbe1-49b8-8fd7-201ee250e310 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1691 microversion: 2.1 time: 0.170386 Sep 02 05:31:43.205414 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 482/964] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:43 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:31:43.659898 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-35644c6b-b42b-4398-98f0-9f199afe245a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:43.661091 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-35644c6b-b42b-4398-98f0-9f199afe245a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:43.672106 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-35644c6b-b42b-4398-98f0-9f199afe245a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:43.672997 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-35644c6b-b42b-4398-98f0-9f199afe245a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:43.673732 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-35644c6b-b42b-4398-98f0-9f199afe245a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:43.674866 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-35644c6b-b42b-4398-98f0-9f199afe245a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:43.675619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-35644c6b-b42b-4398-98f0-9f199afe245a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:43.676381 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-35644c6b-b42b-4398-98f0-9f199afe245a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:43.810485 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-35644c6b-b42b-4398-98f0-9f199afe245a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:43.822955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-35644c6b-b42b-4398-98f0-9f199afe245a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1667 microversion: 2.1 time: 0.170090 Sep 02 05:31:43.823829 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 483/965] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:43 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1667 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:31:44.226239 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-29ccecc3-f852-4271-814d-97d0b74f78fc tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:44.226929 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-29ccecc3-f852-4271-814d-97d0b74f78fc tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:44.233676 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-29ccecc3-f852-4271-814d-97d0b74f78fc tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:44.234174 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-29ccecc3-f852-4271-814d-97d0b74f78fc tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:44.234631 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-29ccecc3-f852-4271-814d-97d0b74f78fc tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:44.235322 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-29ccecc3-f852-4271-814d-97d0b74f78fc tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:44.235798 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-29ccecc3-f852-4271-814d-97d0b74f78fc tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:44.236251 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-29ccecc3-f852-4271-814d-97d0b74f78fc tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:44.373640 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-29ccecc3-f852-4271-814d-97d0b74f78fc tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:44.386249 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-29ccecc3-f852-4271-814d-97d0b74f78fc tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1691 microversion: 2.1 time: 0.163616 Sep 02 05:31:44.387067 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 483/966] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:44 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:31:45.417116 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-745598b3-dbb8-4cde-a2ea-6e3bf2687fa1 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:45.417748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-745598b3-dbb8-4cde-a2ea-6e3bf2687fa1 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:45.424794 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-745598b3-dbb8-4cde-a2ea-6e3bf2687fa1 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:45.425284 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-745598b3-dbb8-4cde-a2ea-6e3bf2687fa1 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:45.425722 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-745598b3-dbb8-4cde-a2ea-6e3bf2687fa1 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:45.426425 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-745598b3-dbb8-4cde-a2ea-6e3bf2687fa1 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:45.426878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-745598b3-dbb8-4cde-a2ea-6e3bf2687fa1 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:45.427287 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-745598b3-dbb8-4cde-a2ea-6e3bf2687fa1 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:45.563471 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-745598b3-dbb8-4cde-a2ea-6e3bf2687fa1 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:45.571783 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-745598b3-dbb8-4cde-a2ea-6e3bf2687fa1 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1691 microversion: 2.1 time: 0.161066 Sep 02 05:31:45.572394 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 484/967] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:45 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:31:46.594484 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-dfdd7ffc-7eba-41d0-adfa-635afe139b36 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:46.595832 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-dfdd7ffc-7eba-41d0-adfa-635afe139b36 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:46.604514 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dfdd7ffc-7eba-41d0-adfa-635afe139b36 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:46.604996 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dfdd7ffc-7eba-41d0-adfa-635afe139b36 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:46.605439 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dfdd7ffc-7eba-41d0-adfa-635afe139b36 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:46.606150 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dfdd7ffc-7eba-41d0-adfa-635afe139b36 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:46.606626 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dfdd7ffc-7eba-41d0-adfa-635afe139b36 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:46.607050 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dfdd7ffc-7eba-41d0-adfa-635afe139b36 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:46.696963 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-dfdd7ffc-7eba-41d0-adfa-635afe139b36 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:46.705137 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-dfdd7ffc-7eba-41d0-adfa-635afe139b36 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1623 microversion: 2.1 time: 0.115479 Sep 02 05:31:46.705698 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 484/968] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:46 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1623 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:31:46.896421 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-7613266e-9771-4b11-bacf-b5fb937145f2 req-fe3246dd-ba77-4a71-a482-8ee28d17977d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc1683c4-1646-485d-99de-4b1591af0455", "name": "network-vif-deleted", "tag": "9b093d1d-f4c7-44e9-a59c-36fc5dbe9a0a"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:31:46.906778 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-7613266e-9771-4b11-bacf-b5fb937145f2 req-fe3246dd-ba77-4a71-a482-8ee28d17977d service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:46.907253 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-7613266e-9771-4b11-bacf-b5fb937145f2 req-fe3246dd-ba77-4a71-a482-8ee28d17977d service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:46.907750 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-7613266e-9771-4b11-bacf-b5fb937145f2 req-fe3246dd-ba77-4a71-a482-8ee28d17977d service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:46.933939 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-7613266e-9771-4b11-bacf-b5fb937145f2 req-fe3246dd-ba77-4a71-a482-8ee28d17977d service nova] Creating event network-vif-deleted:9b093d1d-f4c7-44e9-a59c-36fc5dbe9a0a for instance dc1683c4-1646-485d-99de-4b1591af0455 on hv-cinder-85391 Sep 02 05:31:46.952930 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-7613266e-9771-4b11-bacf-b5fb937145f2 req-fe3246dd-ba77-4a71-a482-8ee28d17977d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059602 Sep 02 05:31:46.954510 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 485/969] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:31:47.726424 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-67718ff9-85dd-4c89-aa41-dec532ee8e02 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:47.726999 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-67718ff9-85dd-4c89-aa41-dec532ee8e02 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:47.735792 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-67718ff9-85dd-4c89-aa41-dec532ee8e02 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:47.736305 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-67718ff9-85dd-4c89-aa41-dec532ee8e02 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:47.736755 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-67718ff9-85dd-4c89-aa41-dec532ee8e02 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:47.737789 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-67718ff9-85dd-4c89-aa41-dec532ee8e02 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:47.738249 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-67718ff9-85dd-4c89-aa41-dec532ee8e02 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:47.738653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-67718ff9-85dd-4c89-aa41-dec532ee8e02 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:47.759079 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:31:47.776768 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-67718ff9-85dd-4c89-aa41-dec532ee8e02 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:47.777270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-67718ff9-85dd-4c89-aa41-dec532ee8e02 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:47.777704 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-67718ff9-85dd-4c89-aa41-dec532ee8e02 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:47.778154 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.objects.instance [None req-67718ff9-85dd-4c89-aa41-dec532ee8e02 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lazy-loading 'fault' on Instance uuid dc1683c4-1646-485d-99de-4b1591af0455 {{(pid=120449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:31:47.819350 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-67718ff9-85dd-4c89-aa41-dec532ee8e02 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:47.828628 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-67718ff9-85dd-4c89-aa41-dec532ee8e02 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 200 len: 1336 microversion: 2.1 time: 0.105800 Sep 02 05:31:47.829196 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 485/970] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:47 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 1336 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:31:48.857347 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-ea7c950b-7972-4a95-a75c-f0d936991894 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:48.858990 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-ea7c950b-7972-4a95-a75c-f0d936991894 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: dc1683c4-1646-485d-99de-4b1591af0455] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:48.870703 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ea7c950b-7972-4a95-a75c-f0d936991894 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:48.871185 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ea7c950b-7972-4a95-a75c-f0d936991894 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:48.871614 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ea7c950b-7972-4a95-a75c-f0d936991894 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:48.872347 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ea7c950b-7972-4a95-a75c-f0d936991894 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:48.872793 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ea7c950b-7972-4a95-a75c-f0d936991894 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:48.873202 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ea7c950b-7972-4a95-a75c-f0d936991894 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:48.886822 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.wsgi [None req-ea7c950b-7972-4a95-a75c-f0d936991894 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] HTTP exception thrown: Instance dc1683c4-1646-485d-99de-4b1591af0455 could not be found. Sep 02 05:31:48.888509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-ea7c950b-7972-4a95-a75c-f0d936991894 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Request method failure captured: Sep 02 05:31:48.888509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: request: GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 HTTP/1.1 Sep 02 05:31:48.888509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept: application/json Sep 02 05:31:48.888509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept-Encoding: identity Sep 02 05:31:48.888509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Connection: close Sep 02 05:31:48.888509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Length: 0 Sep 02 05:31:48.888509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Type: application/json Sep 02 05:31:48.888509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Host: 10.222.0.30 Sep 02 05:31:48.888509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Openstack-System-Scope: None Sep 02 05:31:48.888509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: User-Agent: python-urllib3/1.26.12 Sep 02 05:31:48.888509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Auth-Token: gAAAAABjEZNBlGshjFXTj3Lb-EsC2OrvCSUzgDqiBOUbh8k6e0DYXEDuZx7d2X75THMEeewYJFzTyJmM3mcIGQBFVZgGuF590inOhOXA9tdLJRxjl4ttomYD3QOlAB_biUP2CACfOsx1otZIYpC4WWkCXsXkROF6dcYM2y0smQkEpR6j2BEgLD0 Sep 02 05:31:48.888509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Id: None Sep 02 05:31:48.888509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Name: None Sep 02 05:31:48.888509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Identity-Status: Confirmed Sep 02 05:31:48.888509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Is-Admin-Project: True Sep 02 05:31:48.888509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Id: default Sep 02 05:31:48.888509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Name: Default Sep 02 05:31:48.888509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Id: 8eb15e49aead4c2987f1ac32180db505 Sep 02 05:31:48.888509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1496035544 Sep 02 05:31:48.888509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Role: member,reader Sep 02 05:31:48.888509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Roles: member,reader Sep 02 05:31:48.890119 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8eb15e49aead4c2987f1ac32180db505"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8eb15e49aead4c2987f1ac32180db505"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8eb15e49aead4c2987f1ac32180db505"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8eb15e49aead4c2987f1ac32180db505"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:31:48.890119 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1496035544 Sep 02 05:31:48.890119 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Id: 8eb15e49aead4c2987f1ac32180db505 Sep 02 05:31:48.890119 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1496035544 Sep 02 05:31:48.890119 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User: tempest-ServerRescueNegativeTestJSON-1496035544-project Sep 02 05:31:48.890119 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Id: default Sep 02 05:31:48.890119 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Name: Default Sep 02 05:31:48.890119 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Id: d27e9069d6c4406292c48ea81b2bc78a Sep 02 05:31:48.890119 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1496035544-project Sep 02 05:31:48.890119 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: method: > Sep 02 05:31:48.890119 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: exception: Instance dc1683c4-1646-485d-99de-4b1591af0455 could not be found. Sep 02 05:31:48.890119 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: action_args: {'id': 'dc1683c4-1646-485d-99de-4b1591af0455'} Sep 02 05:31:48.890958 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:31:48.890958 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:31:48.890958 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:31:48.890958 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:31:48.890958 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:31:48.890958 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:31:48.890958 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:31:48.890958 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:31:48.890958 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:31:48.890958 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:31:48.890958 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc1683c4-1646-485d-99de-4b1591af0455 could not be found. Sep 02 05:31:48.890958 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:31:48.890958 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:31:48.890958 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:31:48.890958 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:31:48.890958 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:31:48.890958 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:31:48.890958 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:31:48.890958 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:31:48.890958 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:31:48.892323 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:31:48.892323 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:31:48.892323 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:31:48.892323 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:31:48.892323 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:31:48.892323 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:31:48.892323 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:31:48.892323 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc1683c4-1646-485d-99de-4b1591af0455 could not be found. Sep 02 05:31:48.892323 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:31:48.892323 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:31:48.892323 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:31:48.892323 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:31:48.892323 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:31:48.892323 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:31:48.892323 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:31:48.892323 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:31:48.892323 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc1683c4-1646-485d-99de-4b1591af0455 could not be found. Sep 02 05:31:48.892323 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:31:48.893438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-ea7c950b-7972-4a95-a75c-f0d936991894 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Returning 404 to user: Instance dc1683c4-1646-485d-99de-4b1591af0455 could not be found. {{(pid=120448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:31:48.893438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-ea7c950b-7972-4a95-a75c-f0d936991894 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455" status: 404 len: 111 microversion: 2.1 time: 0.042231 Sep 02 05:31:48.893438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 486/971] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:48 2022] GET /compute/v2.1/servers/dc1683c4-1646-485d-99de-4b1591af0455 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:31:48.898820 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-c13791d6-6bda-40b7-b9cd-ec09105e3d55 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '.version_select at 0x7fc90b21cdc0>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:48.920140 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-c13791d6-6bda-40b7-b9cd-ec09105e3d55 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1726394100" status: 202 len: 0 microversion: 2.1 time: 0.025159 Sep 02 05:31:48.920694 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 486/972] 10.222.0.30 () {58 vars in 1221 bytes} [Fri Sep 2 05:31:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1726394100 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:31:52.088056 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-248e89c7-fb48-42fc-a092-06275f2439e6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:52.088640 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-248e89c7-fb48-42fc-a092-06275f2439e6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:52.091148 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:31:52.096672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-248e89c7-fb48-42fc-a092-06275f2439e6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:52.097157 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-248e89c7-fb48-42fc-a092-06275f2439e6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:52.097596 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-248e89c7-fb48-42fc-a092-06275f2439e6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:52.098293 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-248e89c7-fb48-42fc-a092-06275f2439e6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:52.098736 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-248e89c7-fb48-42fc-a092-06275f2439e6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:52.099168 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-248e89c7-fb48-42fc-a092-06275f2439e6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:52.125699 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-248e89c7-fb48-42fc-a092-06275f2439e6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Going to try to terminate instance {{(pid=120448) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 05:31:52.207484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-248e89c7-fb48-42fc-a092-06275f2439e6 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 204 len: 0 microversion: 2.1 time: 0.122977 Sep 02 05:31:52.207888 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 487/973] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Sep 2 05:31:52 2022] DELETE /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 05:31:52.217123 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-104f5d29-6da0-4c3d-be32-df6f18bac025 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:52.217761 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-104f5d29-6da0-4c3d-be32-df6f18bac025 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:52.224687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-104f5d29-6da0-4c3d-be32-df6f18bac025 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:52.225179 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-104f5d29-6da0-4c3d-be32-df6f18bac025 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:52.225614 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-104f5d29-6da0-4c3d-be32-df6f18bac025 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:52.226301 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-104f5d29-6da0-4c3d-be32-df6f18bac025 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:52.226754 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-104f5d29-6da0-4c3d-be32-df6f18bac025 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:52.227222 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-104f5d29-6da0-4c3d-be32-df6f18bac025 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:52.360953 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-104f5d29-6da0-4c3d-be32-df6f18bac025 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:52.369061 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-104f5d29-6da0-4c3d-be32-df6f18bac025 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1508 microversion: 2.1 time: 0.156667 Sep 02 05:31:52.369690 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 487/974] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:52 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:31:53.391135 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-ffc0df3a-90dc-4fec-88fb-ef76462f030e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:53.392007 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-ffc0df3a-90dc-4fec-88fb-ef76462f030e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:53.399378 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ffc0df3a-90dc-4fec-88fb-ef76462f030e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:53.399866 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ffc0df3a-90dc-4fec-88fb-ef76462f030e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:53.400339 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ffc0df3a-90dc-4fec-88fb-ef76462f030e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:53.401040 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ffc0df3a-90dc-4fec-88fb-ef76462f030e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:53.401462 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ffc0df3a-90dc-4fec-88fb-ef76462f030e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:53.402063 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ffc0df3a-90dc-4fec-88fb-ef76462f030e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:53.698900 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-ffc0df3a-90dc-4fec-88fb-ef76462f030e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:53.707048 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-ffc0df3a-90dc-4fec-88fb-ef76462f030e tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1508 microversion: 2.1 time: 0.320318 Sep 02 05:31:53.707625 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 488/975] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:53 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1508 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:31:53.983011 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-fc0cef3c-9fc5-4770-9592-cf18f5d2a3ed req-6f8a920b-461a-4551-9c41-180b262de96f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ca0f78c-4691-4690-8772-c9fd6cfde418", "name": "network-vif-deleted", "tag": "e4be745a-a91e-4f61-b12b-42bd38befb73"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:31:53.994931 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-fc0cef3c-9fc5-4770-9592-cf18f5d2a3ed req-6f8a920b-461a-4551-9c41-180b262de96f service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:53.995414 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-fc0cef3c-9fc5-4770-9592-cf18f5d2a3ed req-6f8a920b-461a-4551-9c41-180b262de96f service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:53.995844 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-fc0cef3c-9fc5-4770-9592-cf18f5d2a3ed req-6f8a920b-461a-4551-9c41-180b262de96f service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:54.010098 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-fc0cef3c-9fc5-4770-9592-cf18f5d2a3ed req-6f8a920b-461a-4551-9c41-180b262de96f service nova] Creating event network-vif-deleted:e4be745a-a91e-4f61-b12b-42bd38befb73 for instance 7ca0f78c-4691-4690-8772-c9fd6cfde418 on hv-cinder-85391 Sep 02 05:31:54.016605 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-fc0cef3c-9fc5-4770-9592-cf18f5d2a3ed req-6f8a920b-461a-4551-9c41-180b262de96f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038410 Sep 02 05:31:54.017221 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 488/976] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:31:54.729042 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-87d251cc-b577-409a-894f-f2e42f98e2be tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:54.729697 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-87d251cc-b577-409a-894f-f2e42f98e2be tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:54.737221 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-87d251cc-b577-409a-894f-f2e42f98e2be tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:54.737772 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-87d251cc-b577-409a-894f-f2e42f98e2be tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:54.738217 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-87d251cc-b577-409a-894f-f2e42f98e2be tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:54.738901 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-87d251cc-b577-409a-894f-f2e42f98e2be tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:54.739352 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-87d251cc-b577-409a-894f-f2e42f98e2be tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:54.739786 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-87d251cc-b577-409a-894f-f2e42f98e2be tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:54.772080 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-87d251cc-b577-409a-894f-f2e42f98e2be tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:54.772611 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-87d251cc-b577-409a-894f-f2e42f98e2be tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:54.773014 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-87d251cc-b577-409a-894f-f2e42f98e2be tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:54.773447 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.objects.instance [None req-87d251cc-b577-409a-894f-f2e42f98e2be tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lazy-loading 'fault' on Instance uuid 7ca0f78c-4691-4690-8772-c9fd6cfde418 {{(pid=120448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:31:54.816410 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-87d251cc-b577-409a-894f-f2e42f98e2be tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:54.824996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-87d251cc-b577-409a-894f-f2e42f98e2be tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 200 len: 1311 microversion: 2.1 time: 0.099548 Sep 02 05:31:54.825741 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 489/977] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:54 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:31:55.852665 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-67992242-ca51-49e8-bcd8-b4e5a821fff5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:55.853830 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-67992242-ca51-49e8-bcd8-b4e5a821fff5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 7ca0f78c-4691-4690-8772-c9fd6cfde418] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:55.857227 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:31:55.863099 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-67992242-ca51-49e8-bcd8-b4e5a821fff5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:55.863576 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-67992242-ca51-49e8-bcd8-b4e5a821fff5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:55.864017 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-67992242-ca51-49e8-bcd8-b4e5a821fff5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:55.864754 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-67992242-ca51-49e8-bcd8-b4e5a821fff5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:55.865203 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-67992242-ca51-49e8-bcd8-b4e5a821fff5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:55.865619 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-67992242-ca51-49e8-bcd8-b4e5a821fff5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:55.879646 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.wsgi [None req-67992242-ca51-49e8-bcd8-b4e5a821fff5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] HTTP exception thrown: Instance 7ca0f78c-4691-4690-8772-c9fd6cfde418 could not be found. Sep 02 05:31:55.881281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-67992242-ca51-49e8-bcd8-b4e5a821fff5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Request method failure captured: Sep 02 05:31:55.881281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: request: GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 HTTP/1.1 Sep 02 05:31:55.881281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept: application/json Sep 02 05:31:55.881281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept-Encoding: identity Sep 02 05:31:55.881281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Connection: close Sep 02 05:31:55.881281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Length: 0 Sep 02 05:31:55.881281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Type: application/json Sep 02 05:31:55.881281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Host: 10.222.0.30 Sep 02 05:31:55.881281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Openstack-System-Scope: None Sep 02 05:31:55.881281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: User-Agent: python-urllib3/1.26.12 Sep 02 05:31:55.881281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Auth-Token: gAAAAABjEZNBlGshjFXTj3Lb-EsC2OrvCSUzgDqiBOUbh8k6e0DYXEDuZx7d2X75THMEeewYJFzTyJmM3mcIGQBFVZgGuF590inOhOXA9tdLJRxjl4ttomYD3QOlAB_biUP2CACfOsx1otZIYpC4WWkCXsXkROF6dcYM2y0smQkEpR6j2BEgLD0 Sep 02 05:31:55.881281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Id: None Sep 02 05:31:55.881281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Name: None Sep 02 05:31:55.881281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Identity-Status: Confirmed Sep 02 05:31:55.881281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Is-Admin-Project: True Sep 02 05:31:55.881281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Id: default Sep 02 05:31:55.881281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Name: Default Sep 02 05:31:55.881281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Id: 8eb15e49aead4c2987f1ac32180db505 Sep 02 05:31:55.881281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1496035544 Sep 02 05:31:55.881281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Role: member,reader Sep 02 05:31:55.881281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Roles: member,reader Sep 02 05:31:55.882924 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8eb15e49aead4c2987f1ac32180db505"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8eb15e49aead4c2987f1ac32180db505"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8eb15e49aead4c2987f1ac32180db505"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8eb15e49aead4c2987f1ac32180db505"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:31:55.882924 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1496035544 Sep 02 05:31:55.882924 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Id: 8eb15e49aead4c2987f1ac32180db505 Sep 02 05:31:55.882924 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1496035544 Sep 02 05:31:55.882924 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User: tempest-ServerRescueNegativeTestJSON-1496035544-project Sep 02 05:31:55.882924 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Id: default Sep 02 05:31:55.882924 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Name: Default Sep 02 05:31:55.882924 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Id: d27e9069d6c4406292c48ea81b2bc78a Sep 02 05:31:55.882924 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1496035544-project Sep 02 05:31:55.882924 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: method: > Sep 02 05:31:55.882924 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: exception: Instance 7ca0f78c-4691-4690-8772-c9fd6cfde418 could not be found. Sep 02 05:31:55.882924 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: action_args: {'id': '7ca0f78c-4691-4690-8772-c9fd6cfde418'} Sep 02 05:31:55.883727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:31:55.883727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:31:55.883727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:31:55.883727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:31:55.883727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:31:55.883727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:31:55.883727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:31:55.883727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:31:55.883727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:31:55.883727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:31:55.883727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ca0f78c-4691-4690-8772-c9fd6cfde418 could not be found. Sep 02 05:31:55.883727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:31:55.883727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:31:55.883727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:31:55.883727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:31:55.883727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:31:55.883727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:31:55.883727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:31:55.883727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:31:55.883727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:31:55.885009 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:31:55.885009 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:31:55.885009 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:31:55.885009 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:31:55.885009 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:31:55.885009 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:31:55.885009 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:31:55.885009 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ca0f78c-4691-4690-8772-c9fd6cfde418 could not be found. Sep 02 05:31:55.885009 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:31:55.885009 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:31:55.885009 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:31:55.885009 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:31:55.885009 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:31:55.885009 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:31:55.885009 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:31:55.885009 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:31:55.885009 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ca0f78c-4691-4690-8772-c9fd6cfde418 could not be found. Sep 02 05:31:55.885009 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:31:55.886179 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-67992242-ca51-49e8-bcd8-b4e5a821fff5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Returning 404 to user: Instance 7ca0f78c-4691-4690-8772-c9fd6cfde418 could not be found. {{(pid=120449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:31:55.886179 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-67992242-ca51-49e8-bcd8-b4e5a821fff5 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418" status: 404 len: 111 microversion: 2.1 time: 0.037007 Sep 02 05:31:55.886179 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 489/978] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:55 2022] GET /compute/v2.1/servers/7ca0f78c-4691-4690-8772-c9fd6cfde418 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:31:55.891294 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-c5b85218-f294-4a54-bda0-0832b0cd41fe tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:55.891784 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-c5b85218-f294-4a54-bda0-0832b0cd41fe tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:55.898709 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c5b85218-f294-4a54-bda0-0832b0cd41fe tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:55.899200 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c5b85218-f294-4a54-bda0-0832b0cd41fe tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:55.899638 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c5b85218-f294-4a54-bda0-0832b0cd41fe tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:55.900377 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c5b85218-f294-4a54-bda0-0832b0cd41fe tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:55.900811 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c5b85218-f294-4a54-bda0-0832b0cd41fe tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:55.901264 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c5b85218-f294-4a54-bda0-0832b0cd41fe tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:55.926412 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-c5b85218-f294-4a54-bda0-0832b0cd41fe tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Going to try to terminate instance {{(pid=120448) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 05:31:56.012740 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-c5b85218-f294-4a54-bda0-0832b0cd41fe tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "DELETE /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 204 len: 0 microversion: 2.1 time: 0.124969 Sep 02 05:31:56.013257 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 490/979] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Sep 2 05:31:55 2022] DELETE /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 05:31:56.022929 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-32cdc11e-fe69-4689-8b57-2fbad6fed481 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:56.023554 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-32cdc11e-fe69-4689-8b57-2fbad6fed481 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:56.029690 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-32cdc11e-fe69-4689-8b57-2fbad6fed481 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:56.030170 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-32cdc11e-fe69-4689-8b57-2fbad6fed481 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:56.030598 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-32cdc11e-fe69-4689-8b57-2fbad6fed481 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:56.031289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-32cdc11e-fe69-4689-8b57-2fbad6fed481 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:56.031752 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-32cdc11e-fe69-4689-8b57-2fbad6fed481 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:56.032228 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-32cdc11e-fe69-4689-8b57-2fbad6fed481 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:56.177411 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-32cdc11e-fe69-4689-8b57-2fbad6fed481 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:56.185522 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-32cdc11e-fe69-4689-8b57-2fbad6fed481 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1521 microversion: 2.1 time: 0.166479 Sep 02 05:31:56.186083 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 490/980] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:56 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:31:57.206930 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-a93a493e-6917-4b40-b6fd-300220bbf567 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:57.207620 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-a93a493e-6917-4b40-b6fd-300220bbf567 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:57.214566 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a93a493e-6917-4b40-b6fd-300220bbf567 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:57.215052 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a93a493e-6917-4b40-b6fd-300220bbf567 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:57.215482 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a93a493e-6917-4b40-b6fd-300220bbf567 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:57.216294 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a93a493e-6917-4b40-b6fd-300220bbf567 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:57.216734 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a93a493e-6917-4b40-b6fd-300220bbf567 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:57.217152 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a93a493e-6917-4b40-b6fd-300220bbf567 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:57.443530 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-a93a493e-6917-4b40-b6fd-300220bbf567 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27e9069d6c4406292c48ea81b2bc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15e49aead4c2987f1ac32180db505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:31:57.451688 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-a93a493e-6917-4b40-b6fd-300220bbf567 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 200 len: 1521 microversion: 2.1 time: 0.248963 Sep 02 05:31:57.452453 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 491/981] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:57 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:31:57.538853 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-67757765-ac32-40c0-b4c9-eb898be89821 req-8280e9a5-47b5-4c4f-b5ef-32d6d9ea8270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67493ca3-e212-45fa-886f-5c2bc5239f0b", "name": "network-vif-deleted", "tag": "0744525a-63a3-4a71-a8c1-440cbf4eccd2"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:31:57.549249 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-67757765-ac32-40c0-b4c9-eb898be89821 req-8280e9a5-47b5-4c4f-b5ef-32d6d9ea8270 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:57.549717 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-67757765-ac32-40c0-b4c9-eb898be89821 req-8280e9a5-47b5-4c4f-b5ef-32d6d9ea8270 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:57.550277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-67757765-ac32-40c0-b4c9-eb898be89821 req-8280e9a5-47b5-4c4f-b5ef-32d6d9ea8270 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:57.561932 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-67757765-ac32-40c0-b4c9-eb898be89821 req-8280e9a5-47b5-4c4f-b5ef-32d6d9ea8270 service nova] Creating event network-vif-deleted:0744525a-63a3-4a71-a8c1-440cbf4eccd2 for instance 67493ca3-e212-45fa-886f-5c2bc5239f0b on hv-cinder-85391 Sep 02 05:31:57.566707 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-67757765-ac32-40c0-b4c9-eb898be89821 req-8280e9a5-47b5-4c4f-b5ef-32d6d9ea8270 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031501 Sep 02 05:31:57.567380 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 491/982] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:31:58.476109 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-0d0f0ac7-217a-4cf9-869d-c7441cf2b024 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:31:58.477212 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-0d0f0ac7-217a-4cf9-869d-c7441cf2b024 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] [instance: 67493ca3-e212-45fa-886f-5c2bc5239f0b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:31:58.485710 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0d0f0ac7-217a-4cf9-869d-c7441cf2b024 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:58.486192 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0d0f0ac7-217a-4cf9-869d-c7441cf2b024 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:58.486650 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0d0f0ac7-217a-4cf9-869d-c7441cf2b024 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:58.487620 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0d0f0ac7-217a-4cf9-869d-c7441cf2b024 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:31:58.488074 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0d0f0ac7-217a-4cf9-869d-c7441cf2b024 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:31:58.488548 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0d0f0ac7-217a-4cf9-869d-c7441cf2b024 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:31:58.501971 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.wsgi [None req-0d0f0ac7-217a-4cf9-869d-c7441cf2b024 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] HTTP exception thrown: Instance 67493ca3-e212-45fa-886f-5c2bc5239f0b could not be found. Sep 02 05:31:58.503562 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-0d0f0ac7-217a-4cf9-869d-c7441cf2b024 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Request method failure captured: Sep 02 05:31:58.503562 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: request: GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b HTTP/1.1 Sep 02 05:31:58.503562 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept: application/json Sep 02 05:31:58.503562 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept-Encoding: identity Sep 02 05:31:58.503562 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Connection: close Sep 02 05:31:58.503562 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Length: 0 Sep 02 05:31:58.503562 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Type: application/json Sep 02 05:31:58.503562 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Host: 10.222.0.30 Sep 02 05:31:58.503562 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Openstack-System-Scope: None Sep 02 05:31:58.503562 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: User-Agent: python-urllib3/1.26.12 Sep 02 05:31:58.503562 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Auth-Token: gAAAAABjEZNBlGshjFXTj3Lb-EsC2OrvCSUzgDqiBOUbh8k6e0DYXEDuZx7d2X75THMEeewYJFzTyJmM3mcIGQBFVZgGuF590inOhOXA9tdLJRxjl4ttomYD3QOlAB_biUP2CACfOsx1otZIYpC4WWkCXsXkROF6dcYM2y0smQkEpR6j2BEgLD0 Sep 02 05:31:58.503562 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Id: None Sep 02 05:31:58.503562 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Name: None Sep 02 05:31:58.503562 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Identity-Status: Confirmed Sep 02 05:31:58.503562 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Is-Admin-Project: True Sep 02 05:31:58.503562 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Id: default Sep 02 05:31:58.503562 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Name: Default Sep 02 05:31:58.503562 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Id: 8eb15e49aead4c2987f1ac32180db505 Sep 02 05:31:58.503562 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1496035544 Sep 02 05:31:58.503562 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Role: member,reader Sep 02 05:31:58.503562 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Roles: member,reader Sep 02 05:31:58.505102 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8eb15e49aead4c2987f1ac32180db505"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8eb15e49aead4c2987f1ac32180db505"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8eb15e49aead4c2987f1ac32180db505"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8eb15e49aead4c2987f1ac32180db505"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:31:58.505102 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1496035544 Sep 02 05:31:58.505102 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Id: 8eb15e49aead4c2987f1ac32180db505 Sep 02 05:31:58.505102 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1496035544 Sep 02 05:31:58.505102 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User: tempest-ServerRescueNegativeTestJSON-1496035544-project Sep 02 05:31:58.505102 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Id: default Sep 02 05:31:58.505102 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Name: Default Sep 02 05:31:58.505102 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Id: d27e9069d6c4406292c48ea81b2bc78a Sep 02 05:31:58.505102 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1496035544-project Sep 02 05:31:58.505102 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: method: > Sep 02 05:31:58.505102 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: exception: Instance 67493ca3-e212-45fa-886f-5c2bc5239f0b could not be found. Sep 02 05:31:58.505102 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: action_args: {'id': '67493ca3-e212-45fa-886f-5c2bc5239f0b'} Sep 02 05:31:58.505996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:31:58.505996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:31:58.505996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:31:58.505996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:31:58.505996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:31:58.505996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:31:58.505996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:31:58.505996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:31:58.505996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:31:58.505996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:31:58.505996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67493ca3-e212-45fa-886f-5c2bc5239f0b could not be found. Sep 02 05:31:58.505996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:31:58.505996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:31:58.505996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:31:58.505996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:31:58.505996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:31:58.505996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:31:58.505996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:31:58.505996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:31:58.505996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:31:58.507434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:31:58.507434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:31:58.507434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:31:58.507434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:31:58.507434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:31:58.507434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:31:58.507434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:31:58.507434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67493ca3-e212-45fa-886f-5c2bc5239f0b could not be found. Sep 02 05:31:58.507434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:31:58.507434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:31:58.507434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:31:58.507434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:31:58.507434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:31:58.507434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:31:58.507434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:31:58.507434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:31:58.507434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67493ca3-e212-45fa-886f-5c2bc5239f0b could not be found. Sep 02 05:31:58.507434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:31:58.508824 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-0d0f0ac7-217a-4cf9-869d-c7441cf2b024 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] Returning 404 to user: Instance 67493ca3-e212-45fa-886f-5c2bc5239f0b could not be found. {{(pid=120448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:31:58.508824 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-0d0f0ac7-217a-4cf9-869d-c7441cf2b024 tempest-ServerRescueNegativeTestJSON-1496035544 tempest-ServerRescueNegativeTestJSON-1496035544-project] 10.222.0.30 "GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b" status: 404 len: 111 microversion: 2.1 time: 0.035270 Sep 02 05:31:58.508824 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 492/983] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:31:58 2022] GET /compute/v2.1/servers/67493ca3-e212-45fa-886f-5c2bc5239f0b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:32:03.191788 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-7c1759ea-c2b2-4f8e-a7d1-12c32365745e tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] Action: 'create', calling method: .version_select at 0x7fc90b2d0b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1923837959"}} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:32:03.501609 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-7c1759ea-c2b2-4f8e-a7d1-12c32365745e tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.437828 Sep 02 05:32:03.502285 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 492/984] 10.222.0.30 () {60 vars in 1155 bytes} [Fri Sep 2 05:32:03 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 439 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 02 05:32:03.514572 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-b954bf99-e369-45ff-8784-210c7dd7d099 tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] Calling method '.version_select at 0x7fc90ec54f70>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:03.565615 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-b954bf99-e369-45ff-8784-210c7dd7d099 tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/04f7d93c-21c8-4386-8bac-c656e51e1e15" status: 200 len: 345 microversion: 2.1 time: 0.054821 Sep 02 05:32:03.566187 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 493/985] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Sep 2 05:32:03 2022] GET /compute/v2.1/os-volumes/04f7d93c-21c8-4386-8bac-c656e51e1e15 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:32:04.585013 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-d45203a9-5b7e-4ab3-9176-ce7b62c854cf tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] Calling method '.version_select at 0x7fc90b2a2550>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:04.642224 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-d45203a9-5b7e-4ab3-9176-ce7b62c854cf tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/04f7d93c-21c8-4386-8bac-c656e51e1e15" status: 200 len: 345 microversion: 2.1 time: 0.064307 Sep 02 05:32:04.643045 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 493/986] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Sep 2 05:32:04 2022] GET /compute/v2.1/os-volumes/04f7d93c-21c8-4386-8bac-c656e51e1e15 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:32:05.660314 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-e6af9c16-1853-4357-808e-7c582383397a tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] Calling method '.version_select at 0x7fc90b3c8040>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:05.710391 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-e6af9c16-1853-4357-808e-7c582383397a tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/04f7d93c-21c8-4386-8bac-c656e51e1e15" status: 200 len: 346 microversion: 2.1 time: 0.054414 Sep 02 05:32:05.710967 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 494/987] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Sep 2 05:32:05 2022] GET /compute/v2.1/os-volumes/04f7d93c-21c8-4386-8bac-c656e51e1e15 => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:32:05.724056 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-93ab6bd8-903f-4a25-8448-f4027817301a tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] Action: 'create', calling method: .version_select at 0x7fc90b4165e0>, body: {"snapshot": {"volume_id": "04f7d93c-21c8-4386-8bac-c656e51e1e15", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1724984935"}} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:32:05.875711 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-93ab6bd8-903f-4a25-8448-f4027817301a tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] 10.222.0.30 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.155887 Sep 02 05:32:05.876596 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 494/988] 10.222.0.30 () {60 vars in 1162 bytes} [Fri Sep 2 05:32:05 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:32:05.887209 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-ef3a8e20-8b9c-40d4-8e5b-77ad2ef7de36 tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] Calling method '.version_select at 0x7fc90ec44550>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:05.918952 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-ef3a8e20-8b9c-40d4-8e5b-77ad2ef7de36 tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/382d8b4a-b641-46c2-8a11-0ce0299acaae" status: 200 len: 287 microversion: 2.1 time: 0.035532 Sep 02 05:32:05.919521 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 495/989] 10.222.0.30 () {58 vars in 1251 bytes} [Fri Sep 2 05:32:05 2022] GET /compute/v2.1/os-snapshots/382d8b4a-b641-46c2-8a11-0ce0299acaae => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:32:05.930183 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-238bccfb-c31f-4de0-9e1a-e0e8de17d514 tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] Calling method '.version_select at 0x7fc90c7c8040>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:05.962136 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-238bccfb-c31f-4de0-9e1a-e0e8de17d514 tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035377 Sep 02 05:32:05.962943 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 495/990] 10.222.0.30 () {58 vars in 1140 bytes} [Fri Sep 2 05:32:05 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:32:05.973852 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-222bac8f-210b-42e1-bcf6-fd253af063a0 tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] Calling method '.version_select at 0x7fc90b318f70>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:06.014419 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-222bac8f-210b-42e1-bcf6-fd253af063a0 tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/382d8b4a-b641-46c2-8a11-0ce0299acaae" status: 200 len: 287 microversion: 2.1 time: 0.044413 Sep 02 05:32:06.014985 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 496/991] 10.222.0.30 () {58 vars in 1251 bytes} [Fri Sep 2 05:32:05 2022] GET /compute/v2.1/os-snapshots/382d8b4a-b641-46c2-8a11-0ce0299acaae => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:32:07.031749 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-0b226368-c443-485b-ae51-fc392b48346c tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] Calling method '.version_select at 0x7fc90b416790>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:07.066272 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-0b226368-c443-485b-ae51-fc392b48346c tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/382d8b4a-b641-46c2-8a11-0ce0299acaae" status: 200 len: 287 microversion: 2.1 time: 0.041767 Sep 02 05:32:07.066827 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 496/992] 10.222.0.30 () {58 vars in 1251 bytes} [Fri Sep 2 05:32:07 2022] GET /compute/v2.1/os-snapshots/382d8b4a-b641-46c2-8a11-0ce0299acaae => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:32:08.086683 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-fcac1b51-aa8d-40da-a284-8034f1acc525 tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] Calling method '.version_select at 0x7fc90b2ea790>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:08.127745 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-fcac1b51-aa8d-40da-a284-8034f1acc525 tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/382d8b4a-b641-46c2-8a11-0ce0299acaae" status: 200 len: 287 microversion: 2.1 time: 0.050484 Sep 02 05:32:08.128359 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 497/993] 10.222.0.30 () {58 vars in 1251 bytes} [Fri Sep 2 05:32:08 2022] GET /compute/v2.1/os-snapshots/382d8b4a-b641-46c2-8a11-0ce0299acaae => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:32:09.144689 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_api:SELECT=5 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:32:09.146005 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=22 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:32:09.154571 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-29d14b81-3358-4d82-93aa-a494dd403e4e tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] Calling method '.version_select at 0x7fc90b272790>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:09.190492 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-29d14b81-3358-4d82-93aa-a494dd403e4e tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/382d8b4a-b641-46c2-8a11-0ce0299acaae" status: 200 len: 287 microversion: 2.1 time: 0.047850 Sep 02 05:32:09.191079 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 497/994] 10.222.0.30 () {58 vars in 1251 bytes} [Fri Sep 2 05:32:09 2022] GET /compute/v2.1/os-snapshots/382d8b4a-b641-46c2-8a11-0ce0299acaae => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:32:10.202337 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=2 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:32:10.203559 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=67,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:32:10.211822 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-2a888ba4-9b85-4054-a1f9-ab9c7eca9c7b tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] Calling method '.version_select at 0x7fc90ec443a0>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:10.244800 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-2a888ba4-9b85-4054-a1f9-ab9c7eca9c7b tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/382d8b4a-b641-46c2-8a11-0ce0299acaae" status: 200 len: 287 microversion: 2.1 time: 0.044018 Sep 02 05:32:10.245439 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 498/995] 10.222.0.30 () {58 vars in 1251 bytes} [Fri Sep 2 05:32:10 2022] GET /compute/v2.1/os-snapshots/382d8b4a-b641-46c2-8a11-0ce0299acaae => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:32:11.262048 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5152a087-e4df-45b2-badf-7fd8eb59b748 tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] Calling method '.version_select at 0x7fc90b7edf70>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:11.292630 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5152a087-e4df-45b2-badf-7fd8eb59b748 tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/382d8b4a-b641-46c2-8a11-0ce0299acaae" status: 200 len: 287 microversion: 2.1 time: 0.037570 Sep 02 05:32:11.293198 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 498/996] 10.222.0.30 () {58 vars in 1251 bytes} [Fri Sep 2 05:32:11 2022] GET /compute/v2.1/os-snapshots/382d8b4a-b641-46c2-8a11-0ce0299acaae => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:32:12.308225 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-05cfe0fc-d0dc-4559-9782-c5d306b0f8cc tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] Calling method '.version_select at 0x7fc90cf544c0>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:12.338217 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-05cfe0fc-d0dc-4559-9782-c5d306b0f8cc tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/382d8b4a-b641-46c2-8a11-0ce0299acaae" status: 200 len: 288 microversion: 2.1 time: 0.034318 Sep 02 05:32:12.338786 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 499/997] 10.222.0.30 () {58 vars in 1251 bytes} [Fri Sep 2 05:32:12 2022] GET /compute/v2.1/os-snapshots/382d8b4a-b641-46c2-8a11-0ce0299acaae => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:32:12.353097 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-3ca0511b-878c-41f8-843d-04649758e717 tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] Calling method '.version_select at 0x7fc90b416a60>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:12.417583 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-3ca0511b-878c-41f8-843d-04649758e717 tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] 10.222.0.30 "DELETE /compute/v2.1/os-snapshots/382d8b4a-b641-46c2-8a11-0ce0299acaae" status: 202 len: 0 microversion: 2.1 time: 0.071253 Sep 02 05:32:12.418135 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 499/998] 10.222.0.30 () {58 vars in 1254 bytes} [Fri Sep 2 05:32:12 2022] DELETE /compute/v2.1/os-snapshots/382d8b4a-b641-46c2-8a11-0ce0299acaae => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:32:12.428281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-53ca1db0-2a8c-42ee-af26-034a5cb8b33f tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] Calling method '.version_select at 0x7fc90b328430>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:12.458193 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-53ca1db0-2a8c-42ee-af26-034a5cb8b33f tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/382d8b4a-b641-46c2-8a11-0ce0299acaae" status: 200 len: 287 microversion: 2.1 time: 0.033755 Sep 02 05:32:12.458741 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 500/999] 10.222.0.30 () {58 vars in 1251 bytes} [Fri Sep 2 05:32:12 2022] GET /compute/v2.1/os-snapshots/382d8b4a-b641-46c2-8a11-0ce0299acaae => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:32:13.471800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-c001ca4b-f2aa-40ad-b742-d9fd199d8c60 tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] Calling method '.version_select at 0x7fc90b2fd700>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:13.498076 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.wsgi [None req-c001ca4b-f2aa-40ad-b742-d9fd199d8c60 tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] HTTP exception thrown: Snapshot 382d8b4a-b641-46c2-8a11-0ce0299acaae could not be found. Sep 02 05:32:13.501498 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-c001ca4b-f2aa-40ad-b742-d9fd199d8c60 tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] Request method failure captured: Sep 02 05:32:13.501498 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: request: GET /compute/v2.1/os-snapshots/382d8b4a-b641-46c2-8a11-0ce0299acaae HTTP/1.1 Sep 02 05:32:13.501498 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept: application/json Sep 02 05:32:13.501498 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept-Encoding: identity Sep 02 05:32:13.501498 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Connection: close Sep 02 05:32:13.501498 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Length: 0 Sep 02 05:32:13.501498 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Type: application/json Sep 02 05:32:13.501498 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Host: 10.222.0.30 Sep 02 05:32:13.501498 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Openstack-System-Scope: None Sep 02 05:32:13.501498 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: User-Agent: python-urllib3/1.26.12 Sep 02 05:32:13.501498 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Auth-Token: gAAAAABjEZVSBS8WaUTOpQU96ualQl72xUoF67UHJgbky5kv_5yBNIPD0hp2wlJuuiFsWuk9JSxVgYtwIv3AvgqJoO28RshnyypvdvMYNjg2oCRkrABMgG-SAQCVCr3iXHNW_VxDlEwPBDqRzy4ZMSJb2ETlrc4oWKcSIK4M41XiKN0Ce_MkVZc Sep 02 05:32:13.501498 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Id: None Sep 02 05:32:13.501498 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Name: None Sep 02 05:32:13.501498 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Identity-Status: Confirmed Sep 02 05:32:13.501498 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Is-Admin-Project: True Sep 02 05:32:13.501498 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Id: default Sep 02 05:32:13.501498 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Name: Default Sep 02 05:32:13.501498 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Id: 75f0d7d8c63148979bd00fcdeae71a0a Sep 02 05:32:13.501498 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1141297365 Sep 02 05:32:13.501498 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Role: member,reader Sep 02 05:32:13.501498 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Roles: member,reader Sep 02 05:32:13.503138 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_75f0d7d8c63148979bd00fcdeae71a0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/75f0d7d8c63148979bd00fcdeae71a0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/75f0d7d8c63148979bd00fcdeae71a0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/75f0d7d8c63148979bd00fcdeae71a0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:32:13.503138 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1141297365 Sep 02 05:32:13.503138 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Id: 75f0d7d8c63148979bd00fcdeae71a0a Sep 02 05:32:13.503138 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1141297365 Sep 02 05:32:13.503138 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User: tempest-VolumesSnapshotsTestJSON-1141297365-project Sep 02 05:32:13.503138 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Id: default Sep 02 05:32:13.503138 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Name: Default Sep 02 05:32:13.503138 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Id: d9b8f5bedc3d4c1990e219955f3138e4 Sep 02 05:32:13.503138 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1141297365-project Sep 02 05:32:13.503138 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: method: Sep 02 05:32:13.503138 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: exception: Snapshot 382d8b4a-b641-46c2-8a11-0ce0299acaae could not be found. Sep 02 05:32:13.503138 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: action_args: {'id': '382d8b4a-b641-46c2-8a11-0ce0299acaae'} Sep 02 05:32:13.503138 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:32:13.504205 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:13.504205 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 02 05:32:13.504205 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 02 05:32:13.504205 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 02 05:32:13.504205 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 02 05:32:13.504205 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 02 05:32:13.504205 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 02 05:32:13.504205 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 05:32:13.504205 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 05:32:13.504205 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 05:32:13.504205 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 05:32:13.504205 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 05:32:13.504205 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 05:32:13.504205 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 05:32:13.504205 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 05:32:13.504205 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 382d8b4a-b641-46c2-8a11-0ce0299acaae could not be found. (HTTP 404) (Request-ID: req-1cf4280c-1879-4456-a650-d8b872dc046e) Sep 02 05:32:13.504205 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:13.504205 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:13.505557 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:13.505557 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:13.505557 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 02 05:32:13.505557 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 02 05:32:13.505557 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 05:32:13.505557 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 05:32:13.505557 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 02 05:32:13.505557 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 02 05:32:13.505557 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 05:32:13.505557 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 05:32:13.505557 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 02 05:32:13.505557 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 02 05:32:13.505557 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 02 05:32:13.505557 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 02 05:32:13.505557 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 02 05:32:13.505557 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 02 05:32:13.505557 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 05:32:13.505557 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 05:32:13.505557 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 05:32:13.506939 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 05:32:13.506939 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 05:32:13.506939 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 05:32:13.506939 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 05:32:13.506939 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 05:32:13.506939 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 382d8b4a-b641-46c2-8a11-0ce0299acaae could not be found. Sep 02 05:32:13.506939 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:13.506939 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:13.506939 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:13.506939 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:13.506939 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:32:13.506939 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:32:13.506939 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:32:13.506939 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:32:13.506939 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 05:32:13.506939 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 05:32:13.506939 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:32:13.506939 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:32:13.506939 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 02 05:32:13.506939 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:32:13.508413 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 382d8b4a-b641-46c2-8a11-0ce0299acaae could not be found. Sep 02 05:32:13.508413 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:13.508413 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:13.508413 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:13.508413 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:13.508413 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:32:13.508413 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:32:13.508413 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:32:13.508413 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:32:13.508413 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 382d8b4a-b641-46c2-8a11-0ce0299acaae could not be found. Sep 02 05:32:13.508413 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:13.508413 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-c001ca4b-f2aa-40ad-b742-d9fd199d8c60 tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] Returning 404 to user: Snapshot 382d8b4a-b641-46c2-8a11-0ce0299acaae could not be found. {{(pid=120449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:32:13.508413 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-c001ca4b-f2aa-40ad-b742-d9fd199d8c60 tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/382d8b4a-b641-46c2-8a11-0ce0299acaae" status: 404 len: 111 microversion: 2.1 time: 0.036130 Sep 02 05:32:13.509399 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 500/1000] 10.222.0.30 () {58 vars in 1251 bytes} [Fri Sep 2 05:32:13 2022] GET /compute/v2.1/os-snapshots/382d8b4a-b641-46c2-8a11-0ce0299acaae => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:32:13.512672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-344d6bf9-084f-4bef-bf09-8424960a5c7d tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] Calling method '.version_select at 0x7fc90ec44700>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:13.578222 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-344d6bf9-084f-4bef-bf09-8424960a5c7d tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/04f7d93c-21c8-4386-8bac-c656e51e1e15" status: 202 len: 0 microversion: 2.1 time: 0.069783 Sep 02 05:32:13.578793 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 501/1001] 10.222.0.30 () {58 vars in 1248 bytes} [Fri Sep 2 05:32:13 2022] DELETE /compute/v2.1/os-volumes/04f7d93c-21c8-4386-8bac-c656e51e1e15 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:32:13.587116 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-56ae9212-42a9-40f4-888e-4635f716d2ac tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] Calling method '.version_select at 0x7fc90b45d280>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:13.637849 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-56ae9212-42a9-40f4-888e-4635f716d2ac tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/04f7d93c-21c8-4386-8bac-c656e51e1e15" status: 200 len: 345 microversion: 2.1 time: 0.054542 Sep 02 05:32:13.638574 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 501/1002] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Sep 2 05:32:13 2022] GET /compute/v2.1/os-volumes/04f7d93c-21c8-4386-8bac-c656e51e1e15 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:32:14.657393 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f9a69a5b-4700-4b36-bb36-4abf1394d684 tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] Calling method '.version_select at 0x7fc90ec22550>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:14.686502 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.wsgi [None req-f9a69a5b-4700-4b36-bb36-4abf1394d684 tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] HTTP exception thrown: Volume 04f7d93c-21c8-4386-8bac-c656e51e1e15 could not be found. Sep 02 05:32:14.688580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f9a69a5b-4700-4b36-bb36-4abf1394d684 tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] Request method failure captured: Sep 02 05:32:14.688580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: request: GET /compute/v2.1/os-volumes/04f7d93c-21c8-4386-8bac-c656e51e1e15 HTTP/1.1 Sep 02 05:32:14.688580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept: application/json Sep 02 05:32:14.688580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept-Encoding: identity Sep 02 05:32:14.688580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Connection: close Sep 02 05:32:14.688580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Length: 0 Sep 02 05:32:14.688580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Type: application/json Sep 02 05:32:14.688580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Host: 10.222.0.30 Sep 02 05:32:14.688580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Openstack-System-Scope: None Sep 02 05:32:14.688580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: User-Agent: python-urllib3/1.26.12 Sep 02 05:32:14.688580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Auth-Token: gAAAAABjEZVSBS8WaUTOpQU96ualQl72xUoF67UHJgbky5kv_5yBNIPD0hp2wlJuuiFsWuk9JSxVgYtwIv3AvgqJoO28RshnyypvdvMYNjg2oCRkrABMgG-SAQCVCr3iXHNW_VxDlEwPBDqRzy4ZMSJb2ETlrc4oWKcSIK4M41XiKN0Ce_MkVZc Sep 02 05:32:14.688580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Id: None Sep 02 05:32:14.688580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Name: None Sep 02 05:32:14.688580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Identity-Status: Confirmed Sep 02 05:32:14.688580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Is-Admin-Project: True Sep 02 05:32:14.688580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Id: default Sep 02 05:32:14.688580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Name: Default Sep 02 05:32:14.688580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Id: 75f0d7d8c63148979bd00fcdeae71a0a Sep 02 05:32:14.688580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1141297365 Sep 02 05:32:14.688580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Role: member,reader Sep 02 05:32:14.688580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Roles: member,reader Sep 02 05:32:14.690254 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_75f0d7d8c63148979bd00fcdeae71a0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/75f0d7d8c63148979bd00fcdeae71a0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/75f0d7d8c63148979bd00fcdeae71a0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/75f0d7d8c63148979bd00fcdeae71a0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:32:14.690254 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1141297365 Sep 02 05:32:14.690254 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Id: 75f0d7d8c63148979bd00fcdeae71a0a Sep 02 05:32:14.690254 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1141297365 Sep 02 05:32:14.690254 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User: tempest-VolumesSnapshotsTestJSON-1141297365-project Sep 02 05:32:14.690254 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Id: default Sep 02 05:32:14.690254 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Name: Default Sep 02 05:32:14.690254 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Id: d9b8f5bedc3d4c1990e219955f3138e4 Sep 02 05:32:14.690254 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1141297365-project Sep 02 05:32:14.690254 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: method: Sep 02 05:32:14.690254 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: exception: Volume 04f7d93c-21c8-4386-8bac-c656e51e1e15 could not be found. Sep 02 05:32:14.690254 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: action_args: {'id': '04f7d93c-21c8-4386-8bac-c656e51e1e15'} Sep 02 05:32:14.690254 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:32:14.691072 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:14.691072 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 05:32:14.691072 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 05:32:14.691072 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 05:32:14.691072 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 05:32:14.691072 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 05:32:14.691072 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 05:32:14.691072 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 05:32:14.691072 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 05:32:14.691072 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 05:32:14.691072 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 05:32:14.691072 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 05:32:14.691072 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 05:32:14.691072 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 05:32:14.691072 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 05:32:14.691072 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 04f7d93c-21c8-4386-8bac-c656e51e1e15 could not be found. (HTTP 404) (Request-ID: req-0bfab0f4-41b2-4deb-86ef-8bb329f0d706) Sep 02 05:32:14.691072 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:14.691072 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:14.691072 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:14.692245 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:14.692245 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 02 05:32:14.692245 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 02 05:32:14.692245 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 05:32:14.692245 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 05:32:14.692245 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 05:32:14.692245 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 05:32:14.692245 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 05:32:14.692245 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 05:32:14.692245 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 05:32:14.692245 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 05:32:14.692245 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 05:32:14.692245 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 05:32:14.692245 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 05:32:14.692245 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 05:32:14.692245 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 05:32:14.692245 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 05:32:14.692245 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 05:32:14.692245 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 05:32:14.693385 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 05:32:14.693385 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 05:32:14.693385 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 05:32:14.693385 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 05:32:14.693385 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 04f7d93c-21c8-4386-8bac-c656e51e1e15 could not be found. Sep 02 05:32:14.693385 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:14.693385 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:14.693385 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:14.693385 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:14.693385 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:32:14.693385 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:32:14.693385 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:32:14.693385 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:32:14.693385 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 05:32:14.693385 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 05:32:14.693385 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:32:14.693385 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:32:14.693385 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 02 05:32:14.693385 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:32:14.694512 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 04f7d93c-21c8-4386-8bac-c656e51e1e15 could not be found. Sep 02 05:32:14.694512 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:14.694512 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:14.694512 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:14.694512 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:14.694512 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:32:14.694512 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:32:14.694512 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:32:14.694512 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:32:14.694512 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 04f7d93c-21c8-4386-8bac-c656e51e1e15 could not be found. Sep 02 05:32:14.694512 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:14.694512 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f9a69a5b-4700-4b36-bb36-4abf1394d684 tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] Returning 404 to user: Volume 04f7d93c-21c8-4386-8bac-c656e51e1e15 could not be found. {{(pid=120448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:32:14.694512 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f9a69a5b-4700-4b36-bb36-4abf1394d684 tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/04f7d93c-21c8-4386-8bac-c656e51e1e15" status: 404 len: 109 microversion: 2.1 time: 0.039983 Sep 02 05:32:14.694512 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 502/1003] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Sep 2 05:32:14 2022] GET /compute/v2.1/os-volumes/04f7d93c-21c8-4386-8bac-c656e51e1e15 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:32:14.703209 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-61ee24dc-e0c3-4ad5-a8c8-aa4a0f706fc9 tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] Calling method '.version_select at 0x7fc90b7a5e50>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:14.733776 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.wsgi [None req-61ee24dc-e0c3-4ad5-a8c8-aa4a0f706fc9 tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] HTTP exception thrown: Volume 04f7d93c-21c8-4386-8bac-c656e51e1e15 could not be found. Sep 02 05:32:14.736020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-61ee24dc-e0c3-4ad5-a8c8-aa4a0f706fc9 tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] Request method failure captured: Sep 02 05:32:14.736020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: request: DELETE /compute/v2.1/os-volumes/04f7d93c-21c8-4386-8bac-c656e51e1e15 HTTP/1.1 Sep 02 05:32:14.736020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept: application/json Sep 02 05:32:14.736020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept-Encoding: identity Sep 02 05:32:14.736020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Connection: close Sep 02 05:32:14.736020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Length: 0 Sep 02 05:32:14.736020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Type: application/json Sep 02 05:32:14.736020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Host: 10.222.0.30 Sep 02 05:32:14.736020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Openstack-System-Scope: None Sep 02 05:32:14.736020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: User-Agent: python-urllib3/1.26.12 Sep 02 05:32:14.736020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Auth-Token: gAAAAABjEZVSBS8WaUTOpQU96ualQl72xUoF67UHJgbky5kv_5yBNIPD0hp2wlJuuiFsWuk9JSxVgYtwIv3AvgqJoO28RshnyypvdvMYNjg2oCRkrABMgG-SAQCVCr3iXHNW_VxDlEwPBDqRzy4ZMSJb2ETlrc4oWKcSIK4M41XiKN0Ce_MkVZc Sep 02 05:32:14.736020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Id: None Sep 02 05:32:14.736020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Name: None Sep 02 05:32:14.736020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Identity-Status: Confirmed Sep 02 05:32:14.736020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Is-Admin-Project: True Sep 02 05:32:14.736020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Id: default Sep 02 05:32:14.736020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Name: Default Sep 02 05:32:14.736020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Id: 75f0d7d8c63148979bd00fcdeae71a0a Sep 02 05:32:14.736020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1141297365 Sep 02 05:32:14.736020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Role: member,reader Sep 02 05:32:14.736020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Roles: member,reader Sep 02 05:32:14.737851 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_75f0d7d8c63148979bd00fcdeae71a0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/75f0d7d8c63148979bd00fcdeae71a0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/75f0d7d8c63148979bd00fcdeae71a0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/75f0d7d8c63148979bd00fcdeae71a0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:32:14.737851 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1141297365 Sep 02 05:32:14.737851 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Id: 75f0d7d8c63148979bd00fcdeae71a0a Sep 02 05:32:14.737851 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1141297365 Sep 02 05:32:14.737851 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User: tempest-VolumesSnapshotsTestJSON-1141297365-project Sep 02 05:32:14.737851 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Id: default Sep 02 05:32:14.737851 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Name: Default Sep 02 05:32:14.737851 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Id: d9b8f5bedc3d4c1990e219955f3138e4 Sep 02 05:32:14.737851 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1141297365-project Sep 02 05:32:14.737851 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: method: Sep 02 05:32:14.737851 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: exception: Volume 04f7d93c-21c8-4386-8bac-c656e51e1e15 could not be found. Sep 02 05:32:14.737851 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: action_args: {'id': '04f7d93c-21c8-4386-8bac-c656e51e1e15'} Sep 02 05:32:14.737851 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:32:14.738712 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:14.738712 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 05:32:14.738712 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 05:32:14.738712 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 02 05:32:14.738712 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 02 05:32:14.738712 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 02 05:32:14.738712 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 02 05:32:14.738712 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 02 05:32:14.738712 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 02 05:32:14.738712 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 02 05:32:14.738712 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 02 05:32:14.738712 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 05:32:14.738712 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 05:32:14.738712 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 05:32:14.738712 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 05:32:14.738712 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 04f7d93c-21c8-4386-8bac-c656e51e1e15 could not be found. (HTTP 404) (Request-ID: req-79da6fa3-a765-430a-90e1-09969f06c33d) Sep 02 05:32:14.738712 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:14.738712 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:14.738712 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:14.739883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:14.739883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 02 05:32:14.739883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 02 05:32:14.739883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 05:32:14.739883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 05:32:14.739883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 05:32:14.739883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 05:32:14.739883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 05:32:14.739883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 05:32:14.739883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 05:32:14.739883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 05:32:14.739883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 02 05:32:14.739883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 02 05:32:14.739883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 02 05:32:14.739883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 02 05:32:14.739883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 02 05:32:14.739883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 02 05:32:14.739883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 02 05:32:14.739883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 02 05:32:14.741062 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 05:32:14.741062 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 05:32:14.741062 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 05:32:14.741062 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 05:32:14.741062 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 04f7d93c-21c8-4386-8bac-c656e51e1e15 could not be found. Sep 02 05:32:14.741062 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:14.741062 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:14.741062 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:14.741062 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:14.741062 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:32:14.741062 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:32:14.741062 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:32:14.741062 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:32:14.741062 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 05:32:14.741062 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 05:32:14.741062 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:32:14.741062 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:32:14.741062 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 02 05:32:14.741062 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:32:14.742202 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 04f7d93c-21c8-4386-8bac-c656e51e1e15 could not be found. Sep 02 05:32:14.742202 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:14.742202 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:14.742202 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:14.742202 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:14.742202 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:32:14.742202 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:32:14.742202 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:32:14.742202 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:32:14.742202 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 04f7d93c-21c8-4386-8bac-c656e51e1e15 could not be found. Sep 02 05:32:14.742202 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:14.742202 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-61ee24dc-e0c3-4ad5-a8c8-aa4a0f706fc9 tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] Returning 404 to user: Volume 04f7d93c-21c8-4386-8bac-c656e51e1e15 could not be found. {{(pid=120449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:32:14.742202 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-61ee24dc-e0c3-4ad5-a8c8-aa4a0f706fc9 tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/04f7d93c-21c8-4386-8bac-c656e51e1e15" status: 404 len: 109 microversion: 2.1 time: 0.038999 Sep 02 05:32:14.743105 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 502/1004] 10.222.0.30 () {58 vars in 1248 bytes} [Fri Sep 2 05:32:14 2022] DELETE /compute/v2.1/os-volumes/04f7d93c-21c8-4386-8bac-c656e51e1e15 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:32:14.746672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-14a8ac25-ba10-458f-bda1-bfecb634ad2a tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] Calling method '.version_select at 0x7fc90b3c8790>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:14.774513 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.wsgi [None req-14a8ac25-ba10-458f-bda1-bfecb634ad2a tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] HTTP exception thrown: Volume 04f7d93c-21c8-4386-8bac-c656e51e1e15 could not be found. Sep 02 05:32:14.776522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-14a8ac25-ba10-458f-bda1-bfecb634ad2a tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] Request method failure captured: Sep 02 05:32:14.776522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: request: GET /compute/v2.1/os-volumes/04f7d93c-21c8-4386-8bac-c656e51e1e15 HTTP/1.1 Sep 02 05:32:14.776522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept: application/json Sep 02 05:32:14.776522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept-Encoding: identity Sep 02 05:32:14.776522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Connection: close Sep 02 05:32:14.776522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Length: 0 Sep 02 05:32:14.776522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Type: application/json Sep 02 05:32:14.776522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Host: 10.222.0.30 Sep 02 05:32:14.776522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Openstack-System-Scope: None Sep 02 05:32:14.776522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: User-Agent: python-urllib3/1.26.12 Sep 02 05:32:14.776522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Auth-Token: gAAAAABjEZVSBS8WaUTOpQU96ualQl72xUoF67UHJgbky5kv_5yBNIPD0hp2wlJuuiFsWuk9JSxVgYtwIv3AvgqJoO28RshnyypvdvMYNjg2oCRkrABMgG-SAQCVCr3iXHNW_VxDlEwPBDqRzy4ZMSJb2ETlrc4oWKcSIK4M41XiKN0Ce_MkVZc Sep 02 05:32:14.776522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Id: None Sep 02 05:32:14.776522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Name: None Sep 02 05:32:14.776522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Identity-Status: Confirmed Sep 02 05:32:14.776522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Is-Admin-Project: True Sep 02 05:32:14.776522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Id: default Sep 02 05:32:14.776522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Name: Default Sep 02 05:32:14.776522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Id: 75f0d7d8c63148979bd00fcdeae71a0a Sep 02 05:32:14.776522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1141297365 Sep 02 05:32:14.776522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Role: member,reader Sep 02 05:32:14.776522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Roles: member,reader Sep 02 05:32:14.778097 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_75f0d7d8c63148979bd00fcdeae71a0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/75f0d7d8c63148979bd00fcdeae71a0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/75f0d7d8c63148979bd00fcdeae71a0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/75f0d7d8c63148979bd00fcdeae71a0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:32:14.778097 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1141297365 Sep 02 05:32:14.778097 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Id: 75f0d7d8c63148979bd00fcdeae71a0a Sep 02 05:32:14.778097 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1141297365 Sep 02 05:32:14.778097 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User: tempest-VolumesSnapshotsTestJSON-1141297365-project Sep 02 05:32:14.778097 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Id: default Sep 02 05:32:14.778097 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Name: Default Sep 02 05:32:14.778097 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Id: d9b8f5bedc3d4c1990e219955f3138e4 Sep 02 05:32:14.778097 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1141297365-project Sep 02 05:32:14.778097 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: method: Sep 02 05:32:14.778097 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: exception: Volume 04f7d93c-21c8-4386-8bac-c656e51e1e15 could not be found. Sep 02 05:32:14.778097 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: action_args: {'id': '04f7d93c-21c8-4386-8bac-c656e51e1e15'} Sep 02 05:32:14.778097 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:32:14.779048 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:14.779048 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 05:32:14.779048 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 05:32:14.779048 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 05:32:14.779048 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 05:32:14.779048 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 05:32:14.779048 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 05:32:14.779048 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 05:32:14.779048 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 05:32:14.779048 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 05:32:14.779048 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 05:32:14.779048 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 05:32:14.779048 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 05:32:14.779048 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 05:32:14.779048 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 05:32:14.779048 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 04f7d93c-21c8-4386-8bac-c656e51e1e15 could not be found. (HTTP 404) (Request-ID: req-4aa0c2ec-88b0-4658-ae07-1756a36f5636) Sep 02 05:32:14.779048 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:14.779048 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:14.779048 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:14.780424 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:14.780424 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 02 05:32:14.780424 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 02 05:32:14.780424 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 05:32:14.780424 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 05:32:14.780424 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 05:32:14.780424 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 05:32:14.780424 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 05:32:14.780424 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 05:32:14.780424 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 05:32:14.780424 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 05:32:14.780424 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 05:32:14.780424 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 05:32:14.780424 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 05:32:14.780424 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 05:32:14.780424 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 05:32:14.780424 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 05:32:14.780424 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 05:32:14.780424 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 05:32:14.781777 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 05:32:14.781777 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 05:32:14.781777 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 05:32:14.781777 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 05:32:14.781777 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 04f7d93c-21c8-4386-8bac-c656e51e1e15 could not be found. Sep 02 05:32:14.781777 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:14.781777 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:14.781777 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:14.781777 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:14.781777 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:32:14.781777 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:32:14.781777 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:32:14.781777 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:32:14.781777 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 05:32:14.781777 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 05:32:14.781777 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:32:14.781777 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:32:14.781777 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 02 05:32:14.781777 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:32:14.783249 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 04f7d93c-21c8-4386-8bac-c656e51e1e15 could not be found. Sep 02 05:32:14.783249 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:14.783249 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:14.783249 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:14.783249 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:14.783249 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:32:14.783249 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:32:14.783249 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:32:14.783249 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:32:14.783249 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 04f7d93c-21c8-4386-8bac-c656e51e1e15 could not be found. Sep 02 05:32:14.783249 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:14.783249 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-14a8ac25-ba10-458f-bda1-bfecb634ad2a tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] Returning 404 to user: Volume 04f7d93c-21c8-4386-8bac-c656e51e1e15 could not be found. {{(pid=120448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:32:14.783249 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-14a8ac25-ba10-458f-bda1-bfecb634ad2a tempest-VolumesSnapshotsTestJSON-1141297365 tempest-VolumesSnapshotsTestJSON-1141297365-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/04f7d93c-21c8-4386-8bac-c656e51e1e15" status: 404 len: 109 microversion: 2.1 time: 0.035188 Sep 02 05:32:14.783249 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 503/1005] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Sep 2 05:32:14 2022] GET /compute/v2.1/os-volumes/04f7d93c-21c8-4386-8bac-c656e51e1e15 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:32:16.237490 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-dfd46ce7-e436-424c-9096-74e3a7be5655 tempest-VolumesNegativeTest-169756972 tempest-VolumesNegativeTest-169756972-project] Action: 'create', calling method: .version_select at 0x7fc90b7a5f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-813745494", "metadata": {"Type": "work"}}} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:32:16.247957 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-dfd46ce7-e436-424c-9096-74e3a7be5655 tempest-VolumesNegativeTest-169756972 tempest-VolumesNegativeTest-169756972-project] Request method failure captured: Sep 02 05:32:16.247957 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 02 05:32:16.247957 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept: application/json Sep 02 05:32:16.247957 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept-Encoding: identity Sep 02 05:32:16.247957 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Connection: close Sep 02 05:32:16.247957 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Length: 121 Sep 02 05:32:16.247957 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Type: application/json Sep 02 05:32:16.247957 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Host: 10.222.0.30 Sep 02 05:32:16.247957 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Openstack-System-Scope: None Sep 02 05:32:16.247957 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: User-Agent: python-urllib3/1.26.12 Sep 02 05:32:16.247957 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Auth-Token: gAAAAABjEZVgk0lD3B_guZauDtHTQo1og9rKLnyWq_x8GR8svpyRWZB005bg2n44R6kgjGS3JFRm0rezCFuTdpuB2z_2AOtqaAycN7-vG6PSV1LKDc3g0esAmC4IDjCiXSjQfxlVMrZ0YrFB5NIDeYpP4mwBHEkyqATBD7E05XTkDl823U-TFSM Sep 02 05:32:16.247957 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Id: None Sep 02 05:32:16.247957 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Name: None Sep 02 05:32:16.247957 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Identity-Status: Confirmed Sep 02 05:32:16.247957 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Is-Admin-Project: True Sep 02 05:32:16.247957 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Id: default Sep 02 05:32:16.247957 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Name: Default Sep 02 05:32:16.247957 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Id: 2dd76b8ac2c84ffea07b5f318137cd0b Sep 02 05:32:16.247957 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Name: tempest-VolumesNegativeTest-169756972 Sep 02 05:32:16.247957 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Role: member,reader Sep 02 05:32:16.247957 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Roles: member,reader Sep 02 05:32:16.249770 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2dd76b8ac2c84ffea07b5f318137cd0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2dd76b8ac2c84ffea07b5f318137cd0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2dd76b8ac2c84ffea07b5f318137cd0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2dd76b8ac2c84ffea07b5f318137cd0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:32:16.249770 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant: tempest-VolumesNegativeTest-169756972 Sep 02 05:32:16.249770 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Id: 2dd76b8ac2c84ffea07b5f318137cd0b Sep 02 05:32:16.249770 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Name: tempest-VolumesNegativeTest-169756972 Sep 02 05:32:16.249770 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User: tempest-VolumesNegativeTest-169756972-project Sep 02 05:32:16.249770 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Id: default Sep 02 05:32:16.249770 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Name: Default Sep 02 05:32:16.249770 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Id: cb8cbe5d43c04fe18d994d42d3ab7f88 Sep 02 05:32:16.249770 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Name: tempest-VolumesNegativeTest-169756972-project Sep 02 05:32:16.249770 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Sep 02 05:32:16.249770 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-813745494", "metadata": {"Type": "work"}}} Sep 02 05:32:16.249770 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: method: Sep 02 05:32:16.249770 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 02 05:32:16.250829 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-813745494', 'metadata': {'Type': 'work'}}}} Sep 02 05:32:16.250829 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:32:16.250829 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:16.250829 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 02 05:32:16.250829 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 02 05:32:16.250829 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 02 05:32:16.250829 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise error Sep 02 05:32:16.250829 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 02 05:32:16.250829 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.250829 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 02 05:32:16.250829 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 02 05:32:16.250829 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.250829 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 02 05:32:16.250829 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi '#$%' Sep 02 05:32:16.250829 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.250829 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:16.250829 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.250829 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:16.250829 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:32:16.250829 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:32:16.250829 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:32:16.250829 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:32:16.252708 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 05:32:16.252708 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 05:32:16.252708 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:32:16.252708 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:32:16.252708 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 02 05:32:16.252708 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 02 05:32:16.252708 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 02 05:32:16.252708 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 02 05:32:16.252708 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 02 05:32:16.252708 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 02 05:32:16.252708 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 02 05:32:16.252708 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.252708 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:16.252708 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.252708 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:16.252708 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:32:16.252708 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:32:16.252708 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 02 05:32:16.252708 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 02 05:32:16.254178 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 02 05:32:16.254178 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.254178 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-dfd46ce7-e436-424c-9096-74e3a7be5655 tempest-VolumesNegativeTest-169756972 tempest-VolumesNegativeTest-169756972-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:32:16.254178 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-dfd46ce7-e436-424c-9096-74e3a7be5655 tempest-VolumesNegativeTest-169756972 tempest-VolumesNegativeTest-169756972-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.131398 Sep 02 05:32:16.254178 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 503/1006] 10.222.0.30 () {60 vars in 1156 bytes} [Fri Sep 2 05:32:16 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 132 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 05:32:16.259848 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-2408ae56-2c87-49d0-8d00-c9dbf13b7d1e tempest-VolumesNegativeTest-169756972 tempest-VolumesNegativeTest-169756972-project] Action: 'create', calling method: .version_select at 0x7fc90b2e99d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-521215265", "metadata": {"Type": "work"}}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:32:16.264546 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-2408ae56-2c87-49d0-8d00-c9dbf13b7d1e tempest-VolumesNegativeTest-169756972 tempest-VolumesNegativeTest-169756972-project] Request method failure captured: Sep 02 05:32:16.264546 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 02 05:32:16.264546 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept: application/json Sep 02 05:32:16.264546 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept-Encoding: identity Sep 02 05:32:16.264546 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Connection: close Sep 02 05:32:16.264546 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Length: 119 Sep 02 05:32:16.264546 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Type: application/json Sep 02 05:32:16.264546 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Host: 10.222.0.30 Sep 02 05:32:16.264546 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Openstack-System-Scope: None Sep 02 05:32:16.264546 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: User-Agent: python-urllib3/1.26.12 Sep 02 05:32:16.264546 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Auth-Token: gAAAAABjEZVgk0lD3B_guZauDtHTQo1og9rKLnyWq_x8GR8svpyRWZB005bg2n44R6kgjGS3JFRm0rezCFuTdpuB2z_2AOtqaAycN7-vG6PSV1LKDc3g0esAmC4IDjCiXSjQfxlVMrZ0YrFB5NIDeYpP4mwBHEkyqATBD7E05XTkDl823U-TFSM Sep 02 05:32:16.264546 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Id: None Sep 02 05:32:16.264546 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Name: None Sep 02 05:32:16.264546 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Identity-Status: Confirmed Sep 02 05:32:16.264546 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Is-Admin-Project: True Sep 02 05:32:16.264546 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Id: default Sep 02 05:32:16.264546 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Name: Default Sep 02 05:32:16.264546 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Id: 2dd76b8ac2c84ffea07b5f318137cd0b Sep 02 05:32:16.264546 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Name: tempest-VolumesNegativeTest-169756972 Sep 02 05:32:16.264546 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Role: member,reader Sep 02 05:32:16.264546 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Roles: member,reader Sep 02 05:32:16.266130 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2dd76b8ac2c84ffea07b5f318137cd0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2dd76b8ac2c84ffea07b5f318137cd0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2dd76b8ac2c84ffea07b5f318137cd0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2dd76b8ac2c84ffea07b5f318137cd0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:32:16.266130 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant: tempest-VolumesNegativeTest-169756972 Sep 02 05:32:16.266130 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Id: 2dd76b8ac2c84ffea07b5f318137cd0b Sep 02 05:32:16.266130 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Name: tempest-VolumesNegativeTest-169756972 Sep 02 05:32:16.266130 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User: tempest-VolumesNegativeTest-169756972-project Sep 02 05:32:16.266130 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Id: default Sep 02 05:32:16.266130 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Name: Default Sep 02 05:32:16.266130 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Id: cb8cbe5d43c04fe18d994d42d3ab7f88 Sep 02 05:32:16.266130 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Name: tempest-VolumesNegativeTest-169756972-project Sep 02 05:32:16.266130 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Sep 02 05:32:16.266130 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-521215265", "metadata": {"Type": "work"}}} Sep 02 05:32:16.266130 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: method: Sep 02 05:32:16.266130 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 02 05:32:16.267121 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-521215265', 'metadata': {'Type': 'work'}}}} Sep 02 05:32:16.267121 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:32:16.267121 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:16.267121 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 02 05:32:16.267121 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 02 05:32:16.267121 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 02 05:32:16.267121 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise error Sep 02 05:32:16.267121 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 02 05:32:16.267121 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.267121 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 02 05:32:16.267121 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 02 05:32:16.267121 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.267121 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 02 05:32:16.267121 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi '0' Sep 02 05:32:16.267121 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.267121 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:16.267121 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.267121 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:16.267121 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:32:16.267121 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:32:16.267121 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:32:16.267121 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:32:16.268697 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 05:32:16.268697 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 05:32:16.268697 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:32:16.268697 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:32:16.268697 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 02 05:32:16.268697 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 02 05:32:16.268697 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 02 05:32:16.268697 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 02 05:32:16.268697 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 02 05:32:16.268697 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 02 05:32:16.268697 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 02 05:32:16.268697 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.268697 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:16.268697 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.268697 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:16.268697 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:32:16.268697 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:32:16.268697 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 02 05:32:16.268697 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 02 05:32:16.270247 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 02 05:32:16.270247 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.270247 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-2408ae56-2c87-49d0-8d00-c9dbf13b7d1e tempest-VolumesNegativeTest-169756972 tempest-VolumesNegativeTest-169756972-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:32:16.270247 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-2408ae56-2c87-49d0-8d00-c9dbf13b7d1e tempest-VolumesNegativeTest-169756972 tempest-VolumesNegativeTest-169756972-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010405 Sep 02 05:32:16.270247 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 504/1007] 10.222.0.30 () {60 vars in 1156 bytes} [Fri Sep 2 05:32:16 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 05:32:16.275855 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ecbbe8a2-bc42-484d-b7d3-2bdd6f42c254 tempest-VolumesNegativeTest-169756972 tempest-VolumesNegativeTest-169756972-project] Action: 'create', calling method: .version_select at 0x7fc90b43e040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1091105990", "metadata": {"Type": "work"}}} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:32:16.279503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ecbbe8a2-bc42-484d-b7d3-2bdd6f42c254 tempest-VolumesNegativeTest-169756972 tempest-VolumesNegativeTest-169756972-project] Request method failure captured: Sep 02 05:32:16.279503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 02 05:32:16.279503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept: application/json Sep 02 05:32:16.279503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept-Encoding: identity Sep 02 05:32:16.279503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Connection: close Sep 02 05:32:16.279503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Length: 119 Sep 02 05:32:16.279503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Type: application/json Sep 02 05:32:16.279503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Host: 10.222.0.30 Sep 02 05:32:16.279503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Openstack-System-Scope: None Sep 02 05:32:16.279503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: User-Agent: python-urllib3/1.26.12 Sep 02 05:32:16.279503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Auth-Token: gAAAAABjEZVgk0lD3B_guZauDtHTQo1og9rKLnyWq_x8GR8svpyRWZB005bg2n44R6kgjGS3JFRm0rezCFuTdpuB2z_2AOtqaAycN7-vG6PSV1LKDc3g0esAmC4IDjCiXSjQfxlVMrZ0YrFB5NIDeYpP4mwBHEkyqATBD7E05XTkDl823U-TFSM Sep 02 05:32:16.279503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Id: None Sep 02 05:32:16.279503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Name: None Sep 02 05:32:16.279503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Identity-Status: Confirmed Sep 02 05:32:16.279503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Is-Admin-Project: True Sep 02 05:32:16.279503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Id: default Sep 02 05:32:16.279503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Name: Default Sep 02 05:32:16.279503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Id: 2dd76b8ac2c84ffea07b5f318137cd0b Sep 02 05:32:16.279503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Name: tempest-VolumesNegativeTest-169756972 Sep 02 05:32:16.279503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Role: member,reader Sep 02 05:32:16.279503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Roles: member,reader Sep 02 05:32:16.281048 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2dd76b8ac2c84ffea07b5f318137cd0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2dd76b8ac2c84ffea07b5f318137cd0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2dd76b8ac2c84ffea07b5f318137cd0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2dd76b8ac2c84ffea07b5f318137cd0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:32:16.281048 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant: tempest-VolumesNegativeTest-169756972 Sep 02 05:32:16.281048 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Id: 2dd76b8ac2c84ffea07b5f318137cd0b Sep 02 05:32:16.281048 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Name: tempest-VolumesNegativeTest-169756972 Sep 02 05:32:16.281048 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User: tempest-VolumesNegativeTest-169756972-project Sep 02 05:32:16.281048 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Id: default Sep 02 05:32:16.281048 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Name: Default Sep 02 05:32:16.281048 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Id: cb8cbe5d43c04fe18d994d42d3ab7f88 Sep 02 05:32:16.281048 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Name: tempest-VolumesNegativeTest-169756972-project Sep 02 05:32:16.281048 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Sep 02 05:32:16.281048 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1091105990", "metadata": {"Type": "work"}}} Sep 02 05:32:16.281048 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: method: Sep 02 05:32:16.281048 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 02 05:32:16.282019 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1091105990', 'metadata': {'Type': 'work'}}}} Sep 02 05:32:16.282019 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:32:16.282019 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:16.282019 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 02 05:32:16.282019 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 02 05:32:16.282019 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 02 05:32:16.282019 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise error Sep 02 05:32:16.282019 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 02 05:32:16.282019 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.282019 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 02 05:32:16.282019 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 02 05:32:16.282019 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.282019 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 02 05:32:16.282019 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi '' Sep 02 05:32:16.282019 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.282019 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:16.282019 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.282019 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:16.282019 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:32:16.282019 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:32:16.282019 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:32:16.282019 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:32:16.283651 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 05:32:16.283651 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 05:32:16.283651 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:32:16.283651 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:32:16.283651 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 02 05:32:16.283651 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 02 05:32:16.283651 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 02 05:32:16.283651 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 02 05:32:16.283651 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 02 05:32:16.283651 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 02 05:32:16.283651 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 02 05:32:16.283651 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.283651 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:16.283651 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.283651 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:16.283651 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:32:16.283651 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:32:16.283651 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 02 05:32:16.283651 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 02 05:32:16.284973 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 02 05:32:16.284973 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.284973 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ecbbe8a2-bc42-484d-b7d3-2bdd6f42c254 tempest-VolumesNegativeTest-169756972 tempest-VolumesNegativeTest-169756972-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:32:16.284973 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-ecbbe8a2-bc42-484d-b7d3-2bdd6f42c254 tempest-VolumesNegativeTest-169756972 tempest-VolumesNegativeTest-169756972-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009227 Sep 02 05:32:16.284973 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 504/1008] 10.222.0.30 () {60 vars in 1156 bytes} [Fri Sep 2 05:32:16 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 02 05:32:16.291853 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f9071b79-0495-48b5-b601-6af3d07a6177 tempest-VolumesNegativeTest-169756972 tempest-VolumesNegativeTest-169756972-project] Calling method '.version_select at 0x7fc90b3ebc10>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:16.320468 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.wsgi [None req-f9071b79-0495-48b5-b601-6af3d07a6177 tempest-VolumesNegativeTest-169756972 tempest-VolumesNegativeTest-169756972-project] HTTP exception thrown: Volume tempest-invalid-1146454063 could not be found. Sep 02 05:32:16.322494 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f9071b79-0495-48b5-b601-6af3d07a6177 tempest-VolumesNegativeTest-169756972 tempest-VolumesNegativeTest-169756972-project] Request method failure captured: Sep 02 05:32:16.322494 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1146454063 HTTP/1.1 Sep 02 05:32:16.322494 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept: application/json Sep 02 05:32:16.322494 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept-Encoding: identity Sep 02 05:32:16.322494 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Connection: close Sep 02 05:32:16.322494 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Length: 0 Sep 02 05:32:16.322494 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Type: application/json Sep 02 05:32:16.322494 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Host: 10.222.0.30 Sep 02 05:32:16.322494 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Openstack-System-Scope: None Sep 02 05:32:16.322494 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: User-Agent: python-urllib3/1.26.12 Sep 02 05:32:16.322494 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Auth-Token: gAAAAABjEZVgk0lD3B_guZauDtHTQo1og9rKLnyWq_x8GR8svpyRWZB005bg2n44R6kgjGS3JFRm0rezCFuTdpuB2z_2AOtqaAycN7-vG6PSV1LKDc3g0esAmC4IDjCiXSjQfxlVMrZ0YrFB5NIDeYpP4mwBHEkyqATBD7E05XTkDl823U-TFSM Sep 02 05:32:16.322494 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Id: None Sep 02 05:32:16.322494 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Name: None Sep 02 05:32:16.322494 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Identity-Status: Confirmed Sep 02 05:32:16.322494 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Is-Admin-Project: True Sep 02 05:32:16.322494 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Id: default Sep 02 05:32:16.322494 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Name: Default Sep 02 05:32:16.322494 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Id: 2dd76b8ac2c84ffea07b5f318137cd0b Sep 02 05:32:16.322494 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Name: tempest-VolumesNegativeTest-169756972 Sep 02 05:32:16.322494 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Role: member,reader Sep 02 05:32:16.322494 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Roles: member,reader Sep 02 05:32:16.324068 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2dd76b8ac2c84ffea07b5f318137cd0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2dd76b8ac2c84ffea07b5f318137cd0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2dd76b8ac2c84ffea07b5f318137cd0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2dd76b8ac2c84ffea07b5f318137cd0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:32:16.324068 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant: tempest-VolumesNegativeTest-169756972 Sep 02 05:32:16.324068 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Id: 2dd76b8ac2c84ffea07b5f318137cd0b Sep 02 05:32:16.324068 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Name: tempest-VolumesNegativeTest-169756972 Sep 02 05:32:16.324068 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User: tempest-VolumesNegativeTest-169756972-project Sep 02 05:32:16.324068 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Id: default Sep 02 05:32:16.324068 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Name: Default Sep 02 05:32:16.324068 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Id: cb8cbe5d43c04fe18d994d42d3ab7f88 Sep 02 05:32:16.324068 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Name: tempest-VolumesNegativeTest-169756972-project Sep 02 05:32:16.324068 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: method: Sep 02 05:32:16.324068 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: exception: Volume tempest-invalid-1146454063 could not be found. Sep 02 05:32:16.324068 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: action_args: {'id': 'tempest-invalid-1146454063'} Sep 02 05:32:16.324068 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:32:16.325058 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:16.325058 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 05:32:16.325058 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 05:32:16.325058 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 02 05:32:16.325058 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 02 05:32:16.325058 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 02 05:32:16.325058 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 02 05:32:16.325058 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 02 05:32:16.325058 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 02 05:32:16.325058 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 02 05:32:16.325058 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 02 05:32:16.325058 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 05:32:16.325058 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 05:32:16.325058 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 05:32:16.325058 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 05:32:16.325058 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1146454063 could not be found. (HTTP 404) (Request-ID: req-e9809256-c6f0-4f6a-9d57-9d943ed71388) Sep 02 05:32:16.325058 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.325058 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:16.325058 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.326484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:16.326484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 02 05:32:16.326484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 02 05:32:16.326484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 05:32:16.326484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 05:32:16.326484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 05:32:16.326484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 05:32:16.326484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 05:32:16.326484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 05:32:16.326484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 05:32:16.326484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 05:32:16.326484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 02 05:32:16.326484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 02 05:32:16.326484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 02 05:32:16.326484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 02 05:32:16.326484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 02 05:32:16.326484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 02 05:32:16.326484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 02 05:32:16.326484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 02 05:32:16.327879 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 05:32:16.327879 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 05:32:16.327879 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 05:32:16.327879 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 05:32:16.327879 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1146454063 could not be found. Sep 02 05:32:16.327879 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.327879 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:16.327879 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.327879 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:16.327879 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:32:16.327879 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:32:16.327879 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:32:16.327879 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:32:16.327879 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 05:32:16.327879 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 05:32:16.327879 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:32:16.327879 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:32:16.327879 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 02 05:32:16.327879 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:32:16.327879 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1146454063 could not be found. Sep 02 05:32:16.329401 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.329401 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:16.329401 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.329401 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:16.329401 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:32:16.329401 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:32:16.329401 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:32:16.329401 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:32:16.329401 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1146454063 could not be found. Sep 02 05:32:16.329401 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.329401 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f9071b79-0495-48b5-b601-6af3d07a6177 tempest-VolumesNegativeTest-169756972 tempest-VolumesNegativeTest-169756972-project] Returning 404 to user: Volume tempest-invalid-1146454063 could not be found. {{(pid=120448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:32:16.329401 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f9071b79-0495-48b5-b601-6af3d07a6177 tempest-VolumesNegativeTest-169756972 tempest-VolumesNegativeTest-169756972-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1146454063" status: 404 len: 99 microversion: 2.1 time: 0.036755 Sep 02 05:32:16.329401 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 505/1009] 10.222.0.30 () {58 vars in 1218 bytes} [Fri Sep 2 05:32:16 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1146454063 => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 02 05:32:16.334091 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-99587d24-63e2-4289-b9b4-a48d7f7f262c tempest-VolumesNegativeTest-169756972 tempest-VolumesNegativeTest-169756972-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003915 Sep 02 05:32:16.334578 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 505/1010] 10.222.0.30 () {58 vars in 1140 bytes} [Fri Sep 2 05:32:16 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 02 05:32:16.342911 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-55f16198-842a-47b5-8cfd-fcca1a4f0b25 tempest-VolumesNegativeTest-169756972 tempest-VolumesNegativeTest-169756972-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003810 Sep 02 05:32:16.345710 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 506/1011] 10.222.0.30 () {58 vars in 1137 bytes} [Fri Sep 2 05:32:16 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 02 05:32:16.352309 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-0e79f04f-7d84-4ec5-a669-334e68377454 tempest-VolumesNegativeTest-169756972 tempest-VolumesNegativeTest-169756972-project] Calling method '.version_select at 0x7fc90b45db80>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:16.380794 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.wsgi [None req-0e79f04f-7d84-4ec5-a669-334e68377454 tempest-VolumesNegativeTest-169756972 tempest-VolumesNegativeTest-169756972-project] HTTP exception thrown: Volume 2a8107ad-51a6-4821-8195-2512923b9f29 could not be found. Sep 02 05:32:16.383262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-0e79f04f-7d84-4ec5-a669-334e68377454 tempest-VolumesNegativeTest-169756972 tempest-VolumesNegativeTest-169756972-project] Request method failure captured: Sep 02 05:32:16.383262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: request: DELETE /compute/v2.1/os-volumes/2a8107ad-51a6-4821-8195-2512923b9f29 HTTP/1.1 Sep 02 05:32:16.383262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept: application/json Sep 02 05:32:16.383262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept-Encoding: identity Sep 02 05:32:16.383262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Connection: close Sep 02 05:32:16.383262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Length: 0 Sep 02 05:32:16.383262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Type: application/json Sep 02 05:32:16.383262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Host: 10.222.0.30 Sep 02 05:32:16.383262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Openstack-System-Scope: None Sep 02 05:32:16.383262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: User-Agent: python-urllib3/1.26.12 Sep 02 05:32:16.383262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Auth-Token: gAAAAABjEZVgk0lD3B_guZauDtHTQo1og9rKLnyWq_x8GR8svpyRWZB005bg2n44R6kgjGS3JFRm0rezCFuTdpuB2z_2AOtqaAycN7-vG6PSV1LKDc3g0esAmC4IDjCiXSjQfxlVMrZ0YrFB5NIDeYpP4mwBHEkyqATBD7E05XTkDl823U-TFSM Sep 02 05:32:16.383262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Id: None Sep 02 05:32:16.383262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Name: None Sep 02 05:32:16.383262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Identity-Status: Confirmed Sep 02 05:32:16.383262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Is-Admin-Project: True Sep 02 05:32:16.383262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Id: default Sep 02 05:32:16.383262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Name: Default Sep 02 05:32:16.383262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Id: 2dd76b8ac2c84ffea07b5f318137cd0b Sep 02 05:32:16.383262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Name: tempest-VolumesNegativeTest-169756972 Sep 02 05:32:16.383262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Role: member,reader Sep 02 05:32:16.383262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Roles: member,reader Sep 02 05:32:16.384928 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2dd76b8ac2c84ffea07b5f318137cd0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2dd76b8ac2c84ffea07b5f318137cd0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2dd76b8ac2c84ffea07b5f318137cd0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2dd76b8ac2c84ffea07b5f318137cd0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:32:16.384928 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant: tempest-VolumesNegativeTest-169756972 Sep 02 05:32:16.384928 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Id: 2dd76b8ac2c84ffea07b5f318137cd0b Sep 02 05:32:16.384928 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Name: tempest-VolumesNegativeTest-169756972 Sep 02 05:32:16.384928 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User: tempest-VolumesNegativeTest-169756972-project Sep 02 05:32:16.384928 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Id: default Sep 02 05:32:16.384928 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Name: Default Sep 02 05:32:16.384928 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Id: cb8cbe5d43c04fe18d994d42d3ab7f88 Sep 02 05:32:16.384928 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Name: tempest-VolumesNegativeTest-169756972-project Sep 02 05:32:16.384928 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: method: Sep 02 05:32:16.384928 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: exception: Volume 2a8107ad-51a6-4821-8195-2512923b9f29 could not be found. Sep 02 05:32:16.384928 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: action_args: {'id': '2a8107ad-51a6-4821-8195-2512923b9f29'} Sep 02 05:32:16.384928 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:32:16.385911 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:16.385911 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 05:32:16.385911 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 05:32:16.385911 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 02 05:32:16.385911 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 02 05:32:16.385911 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 02 05:32:16.385911 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 02 05:32:16.385911 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 02 05:32:16.385911 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 02 05:32:16.385911 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 02 05:32:16.385911 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 02 05:32:16.385911 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 05:32:16.385911 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 05:32:16.385911 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 05:32:16.385911 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 05:32:16.385911 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2a8107ad-51a6-4821-8195-2512923b9f29 could not be found. (HTTP 404) (Request-ID: req-4aeebac5-2067-4c26-961d-73f892cfd2ee) Sep 02 05:32:16.385911 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.385911 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:16.385911 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.387402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:16.387402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 02 05:32:16.387402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 02 05:32:16.387402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 05:32:16.387402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 05:32:16.387402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 05:32:16.387402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 05:32:16.387402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 05:32:16.387402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 05:32:16.387402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 05:32:16.387402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 05:32:16.387402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 02 05:32:16.387402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 02 05:32:16.387402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 02 05:32:16.387402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 02 05:32:16.387402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 02 05:32:16.387402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 02 05:32:16.387402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 02 05:32:16.387402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 02 05:32:16.388800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 05:32:16.388800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 05:32:16.388800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 05:32:16.388800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 05:32:16.388800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2a8107ad-51a6-4821-8195-2512923b9f29 could not be found. Sep 02 05:32:16.388800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.388800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:16.388800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.388800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:16.388800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:32:16.388800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:32:16.388800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:32:16.388800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:32:16.388800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 05:32:16.388800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 05:32:16.388800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:32:16.388800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:32:16.388800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 02 05:32:16.388800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:32:16.390186 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2a8107ad-51a6-4821-8195-2512923b9f29 could not be found. Sep 02 05:32:16.390186 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.390186 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:16.390186 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.390186 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:16.390186 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:32:16.390186 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:32:16.390186 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:32:16.390186 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:32:16.390186 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2a8107ad-51a6-4821-8195-2512923b9f29 could not be found. Sep 02 05:32:16.390186 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.390186 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-0e79f04f-7d84-4ec5-a669-334e68377454 tempest-VolumesNegativeTest-169756972 tempest-VolumesNegativeTest-169756972-project] Returning 404 to user: Volume 2a8107ad-51a6-4821-8195-2512923b9f29 could not be found. {{(pid=120449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:32:16.390186 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-0e79f04f-7d84-4ec5-a669-334e68377454 tempest-VolumesNegativeTest-169756972 tempest-VolumesNegativeTest-169756972-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/2a8107ad-51a6-4821-8195-2512923b9f29" status: 404 len: 109 microversion: 2.1 time: 0.036328 Sep 02 05:32:16.390186 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 506/1012] 10.222.0.30 () {58 vars in 1248 bytes} [Fri Sep 2 05:32:16 2022] DELETE /compute/v2.1/os-volumes/2a8107ad-51a6-4821-8195-2512923b9f29 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:32:16.394852 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-343280bb-b375-4a17-ac66-daaa44787510 tempest-VolumesNegativeTest-169756972 tempest-VolumesNegativeTest-169756972-project] Calling method '.version_select at 0x7fc90b6feca0>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:16.422592 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.wsgi [None req-343280bb-b375-4a17-ac66-daaa44787510 tempest-VolumesNegativeTest-169756972 tempest-VolumesNegativeTest-169756972-project] HTTP exception thrown: Volume 5070808d-9727-4fa7-a027-39bdaa0d1f56 could not be found. Sep 02 05:32:16.425285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-343280bb-b375-4a17-ac66-daaa44787510 tempest-VolumesNegativeTest-169756972 tempest-VolumesNegativeTest-169756972-project] Request method failure captured: Sep 02 05:32:16.425285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: request: GET /compute/v2.1/os-volumes/5070808d-9727-4fa7-a027-39bdaa0d1f56 HTTP/1.1 Sep 02 05:32:16.425285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept: application/json Sep 02 05:32:16.425285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept-Encoding: identity Sep 02 05:32:16.425285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Connection: close Sep 02 05:32:16.425285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Length: 0 Sep 02 05:32:16.425285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Type: application/json Sep 02 05:32:16.425285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Host: 10.222.0.30 Sep 02 05:32:16.425285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Openstack-System-Scope: None Sep 02 05:32:16.425285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: User-Agent: python-urllib3/1.26.12 Sep 02 05:32:16.425285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Auth-Token: gAAAAABjEZVgk0lD3B_guZauDtHTQo1og9rKLnyWq_x8GR8svpyRWZB005bg2n44R6kgjGS3JFRm0rezCFuTdpuB2z_2AOtqaAycN7-vG6PSV1LKDc3g0esAmC4IDjCiXSjQfxlVMrZ0YrFB5NIDeYpP4mwBHEkyqATBD7E05XTkDl823U-TFSM Sep 02 05:32:16.425285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Id: None Sep 02 05:32:16.425285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Name: None Sep 02 05:32:16.425285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Identity-Status: Confirmed Sep 02 05:32:16.425285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Is-Admin-Project: True Sep 02 05:32:16.425285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Id: default Sep 02 05:32:16.425285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Name: Default Sep 02 05:32:16.425285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Id: 2dd76b8ac2c84ffea07b5f318137cd0b Sep 02 05:32:16.425285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Name: tempest-VolumesNegativeTest-169756972 Sep 02 05:32:16.425285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Role: member,reader Sep 02 05:32:16.425285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Roles: member,reader Sep 02 05:32:16.426784 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2dd76b8ac2c84ffea07b5f318137cd0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2dd76b8ac2c84ffea07b5f318137cd0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2dd76b8ac2c84ffea07b5f318137cd0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2dd76b8ac2c84ffea07b5f318137cd0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:32:16.426784 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant: tempest-VolumesNegativeTest-169756972 Sep 02 05:32:16.426784 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Id: 2dd76b8ac2c84ffea07b5f318137cd0b Sep 02 05:32:16.426784 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Name: tempest-VolumesNegativeTest-169756972 Sep 02 05:32:16.426784 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User: tempest-VolumesNegativeTest-169756972-project Sep 02 05:32:16.426784 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Id: default Sep 02 05:32:16.426784 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Name: Default Sep 02 05:32:16.426784 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Id: cb8cbe5d43c04fe18d994d42d3ab7f88 Sep 02 05:32:16.426784 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Name: tempest-VolumesNegativeTest-169756972-project Sep 02 05:32:16.426784 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: method: Sep 02 05:32:16.426784 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: exception: Volume 5070808d-9727-4fa7-a027-39bdaa0d1f56 could not be found. Sep 02 05:32:16.426784 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: action_args: {'id': '5070808d-9727-4fa7-a027-39bdaa0d1f56'} Sep 02 05:32:16.426784 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:32:16.427751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:16.427751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 05:32:16.427751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 05:32:16.427751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 05:32:16.427751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 05:32:16.427751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 05:32:16.427751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 05:32:16.427751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 05:32:16.427751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 05:32:16.427751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 05:32:16.427751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 05:32:16.427751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 05:32:16.427751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 05:32:16.427751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 05:32:16.427751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 05:32:16.427751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5070808d-9727-4fa7-a027-39bdaa0d1f56 could not be found. (HTTP 404) (Request-ID: req-2bee1b5d-230b-405e-af7a-1a3036a40a00) Sep 02 05:32:16.427751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.427751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:16.427751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.429186 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:16.429186 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 02 05:32:16.429186 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 02 05:32:16.429186 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 05:32:16.429186 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 05:32:16.429186 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 05:32:16.429186 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 05:32:16.429186 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 05:32:16.429186 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 05:32:16.429186 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 05:32:16.429186 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 05:32:16.429186 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 05:32:16.429186 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 05:32:16.429186 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 05:32:16.429186 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 05:32:16.429186 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 05:32:16.429186 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 05:32:16.429186 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 05:32:16.429186 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 05:32:16.430455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 05:32:16.430455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 05:32:16.430455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 05:32:16.430455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 05:32:16.430455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5070808d-9727-4fa7-a027-39bdaa0d1f56 could not be found. Sep 02 05:32:16.430455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.430455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:16.430455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.430455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:16.430455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:32:16.430455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:32:16.430455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:32:16.430455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:32:16.430455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 05:32:16.430455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 05:32:16.430455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:32:16.430455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:32:16.430455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 02 05:32:16.430455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:32:16.431688 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5070808d-9727-4fa7-a027-39bdaa0d1f56 could not be found. Sep 02 05:32:16.431688 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.431688 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:16.431688 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.431688 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:16.431688 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:32:16.431688 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:32:16.431688 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:32:16.431688 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:32:16.431688 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5070808d-9727-4fa7-a027-39bdaa0d1f56 could not be found. Sep 02 05:32:16.431688 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:16.431688 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-343280bb-b375-4a17-ac66-daaa44787510 tempest-VolumesNegativeTest-169756972 tempest-VolumesNegativeTest-169756972-project] Returning 404 to user: Volume 5070808d-9727-4fa7-a027-39bdaa0d1f56 could not be found. {{(pid=120448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:32:16.431688 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-343280bb-b375-4a17-ac66-daaa44787510 tempest-VolumesNegativeTest-169756972 tempest-VolumesNegativeTest-169756972-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/5070808d-9727-4fa7-a027-39bdaa0d1f56" status: 404 len: 109 microversion: 2.1 time: 0.035866 Sep 02 05:32:16.431688 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 507/1013] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Sep 2 05:32:16 2022] GET /compute/v2.1/os-volumes/5070808d-9727-4fa7-a027-39bdaa0d1f56 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 05:32:34.879419 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-4eb9a940-657a-4631-a534-c4604c0cd125 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:34.880044 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-4eb9a940-657a-4631-a534-c4604c0cd125 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:34.881497 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-1aaf4116-2c43-4afb-a6a4-9f9012369c43 req-02ad144d-2c82-4ffb-82d1-c7944011da09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9feba72e-7abe-4be7-b75e-51262eb201a1", "tag": "efc651b2-eb48-40f2-aa6e-8bca71be2b42"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:32:34.887054 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4eb9a940-657a-4631-a534-c4604c0cd125 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:34.887548 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4eb9a940-657a-4631-a534-c4604c0cd125 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:34.888199 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4eb9a940-657a-4631-a534-c4604c0cd125 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:34.888903 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4eb9a940-657a-4631-a534-c4604c0cd125 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:34.889358 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4eb9a940-657a-4631-a534-c4604c0cd125 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:34.889784 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4eb9a940-657a-4631-a534-c4604c0cd125 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:34.892312 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-1aaf4116-2c43-4afb-a6a4-9f9012369c43 req-02ad144d-2c82-4ffb-82d1-c7944011da09 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:34.893051 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-1aaf4116-2c43-4afb-a6a4-9f9012369c43 req-02ad144d-2c82-4ffb-82d1-c7944011da09 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:34.893565 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-1aaf4116-2c43-4afb-a6a4-9f9012369c43 req-02ad144d-2c82-4ffb-82d1-c7944011da09 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:34.905346 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-1aaf4116-2c43-4afb-a6a4-9f9012369c43 req-02ad144d-2c82-4ffb-82d1-c7944011da09 service nova] Creating event network-changed:efc651b2-eb48-40f2-aa6e-8bca71be2b42 for instance 9feba72e-7abe-4be7-b75e-51262eb201a1 on hv-cinder-85391 Sep 02 05:32:34.912601 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-1aaf4116-2c43-4afb-a6a4-9f9012369c43 req-02ad144d-2c82-4ffb-82d1-c7944011da09 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035630 Sep 02 05:32:34.913501 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 508/1014] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:32:34.920106 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-4eb9a940-657a-4631-a534-c4604c0cd125 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Going to try to terminate instance {{(pid=120449) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 05:32:35.016848 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-4eb9a940-657a-4631-a534-c4604c0cd125 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 204 len: 0 microversion: 2.1 time: 0.142112 Sep 02 05:32:35.018123 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 507/1015] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Sep 2 05:32:34 2022] DELETE /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 05:32:35.027027 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f3b9e414-3724-4dea-8b5e-09ae947f36df tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:35.027878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f3b9e414-3724-4dea-8b5e-09ae947f36df tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:35.034370 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f3b9e414-3724-4dea-8b5e-09ae947f36df tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:35.034847 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f3b9e414-3724-4dea-8b5e-09ae947f36df tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:35.035276 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f3b9e414-3724-4dea-8b5e-09ae947f36df tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:35.035960 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f3b9e414-3724-4dea-8b5e-09ae947f36df tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:35.036432 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f3b9e414-3724-4dea-8b5e-09ae947f36df tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:35.036850 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f3b9e414-3724-4dea-8b5e-09ae947f36df tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:35.176088 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f3b9e414-3724-4dea-8b5e-09ae947f36df tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:35.184752 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f3b9e414-3724-4dea-8b5e-09ae947f36df tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1568 microversion: 2.1 time: 0.162270 Sep 02 05:32:35.185408 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 509/1016] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:32:35 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:32:36.211479 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-c53a3287-2fa0-45bc-a0c8-b9a4cb1d4b57 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:36.212657 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-c53a3287-2fa0-45bc-a0c8-b9a4cb1d4b57 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:36.223498 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c53a3287-2fa0-45bc-a0c8-b9a4cb1d4b57 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:36.224343 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c53a3287-2fa0-45bc-a0c8-b9a4cb1d4b57 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:36.225068 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c53a3287-2fa0-45bc-a0c8-b9a4cb1d4b57 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:36.226238 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c53a3287-2fa0-45bc-a0c8-b9a4cb1d4b57 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:36.226989 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c53a3287-2fa0-45bc-a0c8-b9a4cb1d4b57 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:36.227673 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c53a3287-2fa0-45bc-a0c8-b9a4cb1d4b57 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:36.465283 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-c53a3287-2fa0-45bc-a0c8-b9a4cb1d4b57 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:36.474621 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-c53a3287-2fa0-45bc-a0c8-b9a4cb1d4b57 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1568 microversion: 2.1 time: 0.270330 Sep 02 05:32:36.475213 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 508/1017] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:32:36 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1568 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:32:37.496867 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-39e09f07-f5a3-4694-be26-dfb5eef19ff8 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:37.497502 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-39e09f07-f5a3-4694-be26-dfb5eef19ff8 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:37.504330 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-39e09f07-f5a3-4694-be26-dfb5eef19ff8 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:37.504789 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-39e09f07-f5a3-4694-be26-dfb5eef19ff8 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:37.505200 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-39e09f07-f5a3-4694-be26-dfb5eef19ff8 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:37.505892 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-39e09f07-f5a3-4694-be26-dfb5eef19ff8 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:37.506374 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-39e09f07-f5a3-4694-be26-dfb5eef19ff8 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:37.506779 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-39e09f07-f5a3-4694-be26-dfb5eef19ff8 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:37.639932 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-39e09f07-f5a3-4694-be26-dfb5eef19ff8 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:37.648135 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-39e09f07-f5a3-4694-be26-dfb5eef19ff8 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1450 microversion: 2.1 time: 0.155308 Sep 02 05:32:37.648840 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 510/1018] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:32:37 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:32:37.761329 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-47788302-ceba-4580-a7a1-7345e45b858b req-f08dcf90-9d83-4dc2-acf9-c42b3ad01a62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9feba72e-7abe-4be7-b75e-51262eb201a1", "name": "network-vif-deleted", "tag": "efc651b2-eb48-40f2-aa6e-8bca71be2b42"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:32:37.771068 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-47788302-ceba-4580-a7a1-7345e45b858b req-f08dcf90-9d83-4dc2-acf9-c42b3ad01a62 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:37.771543 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-47788302-ceba-4580-a7a1-7345e45b858b req-f08dcf90-9d83-4dc2-acf9-c42b3ad01a62 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:37.771969 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-47788302-ceba-4580-a7a1-7345e45b858b req-f08dcf90-9d83-4dc2-acf9-c42b3ad01a62 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:37.785215 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-47788302-ceba-4580-a7a1-7345e45b858b req-f08dcf90-9d83-4dc2-acf9-c42b3ad01a62 service nova] Creating event network-vif-deleted:efc651b2-eb48-40f2-aa6e-8bca71be2b42 for instance 9feba72e-7abe-4be7-b75e-51262eb201a1 on hv-cinder-85391 Sep 02 05:32:37.791143 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-47788302-ceba-4580-a7a1-7345e45b858b req-f08dcf90-9d83-4dc2-acf9-c42b3ad01a62 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032579 Sep 02 05:32:37.792063 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 509/1019] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:32:38.674334 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-0a6a6765-6f76-4a00-8909-e55dd501f194 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:38.675442 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-0a6a6765-6f76-4a00-8909-e55dd501f194 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:38.685889 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0a6a6765-6f76-4a00-8909-e55dd501f194 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:38.686366 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0a6a6765-6f76-4a00-8909-e55dd501f194 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:38.686840 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0a6a6765-6f76-4a00-8909-e55dd501f194 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:38.687580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0a6a6765-6f76-4a00-8909-e55dd501f194 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:38.688026 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0a6a6765-6f76-4a00-8909-e55dd501f194 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:38.688470 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0a6a6765-6f76-4a00-8909-e55dd501f194 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:38.722882 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0a6a6765-6f76-4a00-8909-e55dd501f194 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:38.723454 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0a6a6765-6f76-4a00-8909-e55dd501f194 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:38.723900 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0a6a6765-6f76-4a00-8909-e55dd501f194 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:38.724366 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.objects.instance [None req-0a6a6765-6f76-4a00-8909-e55dd501f194 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lazy-loading 'fault' on Instance uuid 9feba72e-7abe-4be7-b75e-51262eb201a1 {{(pid=120448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:32:38.771480 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-0a6a6765-6f76-4a00-8909-e55dd501f194 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268723dc1de74a53b6379fae0626e02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edadaa7db8145ab9ddb2d2ed4a3a5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:38.780866 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-0a6a6765-6f76-4a00-8909-e55dd501f194 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 200 len: 1225 microversion: 2.1 time: 0.113683 Sep 02 05:32:38.781433 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 511/1020] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:32:38 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:32:39.802828 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-8ab8a643-2b0a-4d02-880c-d33ae22c27a2 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:39.803530 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-8ab8a643-2b0a-4d02-880c-d33ae22c27a2 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] [instance: 9feba72e-7abe-4be7-b75e-51262eb201a1] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:39.810630 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8ab8a643-2b0a-4d02-880c-d33ae22c27a2 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:39.811114 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8ab8a643-2b0a-4d02-880c-d33ae22c27a2 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:39.811551 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8ab8a643-2b0a-4d02-880c-d33ae22c27a2 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:39.812273 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8ab8a643-2b0a-4d02-880c-d33ae22c27a2 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:39.812733 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8ab8a643-2b0a-4d02-880c-d33ae22c27a2 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:39.813165 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8ab8a643-2b0a-4d02-880c-d33ae22c27a2 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:39.826593 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.wsgi [None req-8ab8a643-2b0a-4d02-880c-d33ae22c27a2 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] HTTP exception thrown: Instance 9feba72e-7abe-4be7-b75e-51262eb201a1 could not be found. Sep 02 05:32:39.828270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-8ab8a643-2b0a-4d02-880c-d33ae22c27a2 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Request method failure captured: Sep 02 05:32:39.828270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: request: GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 HTTP/1.1 Sep 02 05:32:39.828270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept: application/json Sep 02 05:32:39.828270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept-Encoding: identity Sep 02 05:32:39.828270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Connection: close Sep 02 05:32:39.828270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Length: 0 Sep 02 05:32:39.828270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Type: application/json Sep 02 05:32:39.828270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Host: 10.222.0.30 Sep 02 05:32:39.828270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Openstack-System-Scope: None Sep 02 05:32:39.828270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: User-Agent: python-urllib3/1.26.12 Sep 02 05:32:39.828270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Auth-Token: gAAAAABjEZOc0qLSiUovlclJNPkKJgThLDDysObrcTaZxezIGfqrjxxQmW9LYsx8wQiTn0ucq91i9TyqgFWQjb-x1u6TAx79ZWfAF4NXxRNTaay1b8esSN_-lcjKRV-BxcYvEnme8d9WHMU2y9iyUBTMEROmXo4Hji4wDl_7fq0hSzQfQg-zsFk Sep 02 05:32:39.828270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Id: None Sep 02 05:32:39.828270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Name: None Sep 02 05:32:39.828270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Identity-Status: Confirmed Sep 02 05:32:39.828270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Is-Admin-Project: True Sep 02 05:32:39.828270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Id: default Sep 02 05:32:39.828270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Name: Default Sep 02 05:32:39.828270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Id: 7edadaa7db8145ab9ddb2d2ed4a3a5df Sep 02 05:32:39.828270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Name: tempest-TestShelveInstance-477699954 Sep 02 05:32:39.828270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Role: member,reader Sep 02 05:32:39.828270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Roles: member,reader Sep 02 05:32:39.829806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7edadaa7db8145ab9ddb2d2ed4a3a5df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7edadaa7db8145ab9ddb2d2ed4a3a5df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7edadaa7db8145ab9ddb2d2ed4a3a5df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7edadaa7db8145ab9ddb2d2ed4a3a5df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:32:39.829806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant: tempest-TestShelveInstance-477699954 Sep 02 05:32:39.829806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Id: 7edadaa7db8145ab9ddb2d2ed4a3a5df Sep 02 05:32:39.829806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Name: tempest-TestShelveInstance-477699954 Sep 02 05:32:39.829806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User: tempest-TestShelveInstance-477699954-project Sep 02 05:32:39.829806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Id: default Sep 02 05:32:39.829806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Name: Default Sep 02 05:32:39.829806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Id: 268723dc1de74a53b6379fae0626e02b Sep 02 05:32:39.829806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Name: tempest-TestShelveInstance-477699954-project Sep 02 05:32:39.829806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: method: > Sep 02 05:32:39.829806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: exception: Instance 9feba72e-7abe-4be7-b75e-51262eb201a1 could not be found. Sep 02 05:32:39.829806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: action_args: {'id': '9feba72e-7abe-4be7-b75e-51262eb201a1'} Sep 02 05:32:39.830736 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:32:39.830736 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:39.830736 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:32:39.830736 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:32:39.830736 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:32:39.830736 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:32:39.830736 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:32:39.830736 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:32:39.830736 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:32:39.830736 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:32:39.830736 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9feba72e-7abe-4be7-b75e-51262eb201a1 could not be found. Sep 02 05:32:39.830736 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:39.830736 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:39.830736 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:39.830736 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:39.830736 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:32:39.830736 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:32:39.830736 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:32:39.830736 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:32:39.830736 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:32:39.832225 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:32:39.832225 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:32:39.832225 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:32:39.832225 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:32:39.832225 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:32:39.832225 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:32:39.832225 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:32:39.832225 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9feba72e-7abe-4be7-b75e-51262eb201a1 could not be found. Sep 02 05:32:39.832225 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:39.832225 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:39.832225 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:39.832225 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:39.832225 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:32:39.832225 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:32:39.832225 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:32:39.832225 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:32:39.832225 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9feba72e-7abe-4be7-b75e-51262eb201a1 could not be found. Sep 02 05:32:39.832225 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:39.833615 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-8ab8a643-2b0a-4d02-880c-d33ae22c27a2 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Returning 404 to user: Instance 9feba72e-7abe-4be7-b75e-51262eb201a1 could not be found. {{(pid=120449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:32:39.833615 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-8ab8a643-2b0a-4d02-880c-d33ae22c27a2 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1" status: 404 len: 111 microversion: 2.1 time: 0.031232 Sep 02 05:32:39.833615 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 510/1021] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:32:39 2022] GET /compute/v2.1/servers/9feba72e-7abe-4be7-b75e-51262eb201a1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:32:39.998919 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d947e713-b5d8-4687-8e93-72596bc74097 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] Calling method '.version_select at 0x7fc90b41baf0>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:40.022199 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-d947e713-b5d8-4687-8e93-72596bc74097 tempest-TestShelveInstance-477699954 tempest-TestShelveInstance-477699954-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1688213221" status: 202 len: 0 microversion: 2.1 time: 0.027575 Sep 02 05:32:40.023175 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 512/1022] 10.222.0.30 () {58 vars in 1254 bytes} [Fri Sep 2 05:32:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1688213221 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:32:42.999900 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-c311c8fe-9317-4da7-b579-e936210d38f0 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:43.000524 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-c311c8fe-9317-4da7-b579-e936210d38f0 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:43.007431 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c311c8fe-9317-4da7-b579-e936210d38f0 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:43.009015 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c311c8fe-9317-4da7-b579-e936210d38f0 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:43.009546 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c311c8fe-9317-4da7-b579-e936210d38f0 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:43.010257 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c311c8fe-9317-4da7-b579-e936210d38f0 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:43.010890 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c311c8fe-9317-4da7-b579-e936210d38f0 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:43.011315 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c311c8fe-9317-4da7-b579-e936210d38f0 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:43.039403 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-c311c8fe-9317-4da7-b579-e936210d38f0 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0/ips" status: 200 len: 149 microversion: 2.1 time: 0.043231 Sep 02 05:32:43.040500 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 511/1023] 10.222.0.30 () {58 vars in 1248 bytes} [Fri Sep 2 05:32:42 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:32:43.448730 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-5f20bdf3-66c3-4f6b-937a-5b8173dfcb88 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:43.449514 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-5f20bdf3-66c3-4f6b-937a-5b8173dfcb88 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:43.462092 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5f20bdf3-66c3-4f6b-937a-5b8173dfcb88 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:43.463372 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5f20bdf3-66c3-4f6b-937a-5b8173dfcb88 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:43.472984 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5f20bdf3-66c3-4f6b-937a-5b8173dfcb88 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:43.474256 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5f20bdf3-66c3-4f6b-937a-5b8173dfcb88 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:43.475105 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5f20bdf3-66c3-4f6b-937a-5b8173dfcb88 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:43.477033 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5f20bdf3-66c3-4f6b-937a-5b8173dfcb88 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:43.559466 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-5f20bdf3-66c3-4f6b-937a-5b8173dfcb88 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Going to try to terminate instance {{(pid=120448) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 05:32:43.701316 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-5f20bdf3-66c3-4f6b-937a-5b8173dfcb88 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 204 len: 0 microversion: 2.1 time: 0.256301 Sep 02 05:32:43.705183 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 513/1024] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Sep 2 05:32:43 2022] DELETE /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 05:32:43.715176 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-b6a0e26a-3b0f-4192-9241-db8ad22b8eeb tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:43.716214 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-b6a0e26a-3b0f-4192-9241-db8ad22b8eeb tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:43.731161 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b6a0e26a-3b0f-4192-9241-db8ad22b8eeb tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:43.733060 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b6a0e26a-3b0f-4192-9241-db8ad22b8eeb tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:43.734205 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b6a0e26a-3b0f-4192-9241-db8ad22b8eeb tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:43.735137 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b6a0e26a-3b0f-4192-9241-db8ad22b8eeb tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:43.735765 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b6a0e26a-3b0f-4192-9241-db8ad22b8eeb tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:43.737108 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b6a0e26a-3b0f-4192-9241-db8ad22b8eeb tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:44.040914 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-b6a0e26a-3b0f-4192-9241-db8ad22b8eeb tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:44.051880 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-b6a0e26a-3b0f-4192-9241-db8ad22b8eeb tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1576 microversion: 2.1 time: 0.345109 Sep 02 05:32:44.052797 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 512/1025] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:32:43 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1576 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:32:44.605400 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-4180dce3-161c-4262-8e15-ed80eda5b14e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27447b99-f3c2-4fda-b90e-d4db1ca099d8"}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:32:44.607905 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-4180dce3-161c-4262-8e15-ed80eda5b14e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:44.614709 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4180dce3-161c-4262-8e15-ed80eda5b14e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:44.615343 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4180dce3-161c-4262-8e15-ed80eda5b14e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:44.615783 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4180dce3-161c-4262-8e15-ed80eda5b14e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:44.616509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4180dce3-161c-4262-8e15-ed80eda5b14e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:44.617128 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4180dce3-161c-4262-8e15-ed80eda5b14e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:44.617719 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4180dce3-161c-4262-8e15-ed80eda5b14e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:45.079831 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-01104c87-ea73-4e11-9a80-c51dda69c734 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:45.080690 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-01104c87-ea73-4e11-9a80-c51dda69c734 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:45.094737 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-01104c87-ea73-4e11-9a80-c51dda69c734 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:45.095289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-01104c87-ea73-4e11-9a80-c51dda69c734 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:45.095873 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-01104c87-ea73-4e11-9a80-c51dda69c734 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:45.096612 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-01104c87-ea73-4e11-9a80-c51dda69c734 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:45.097202 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-01104c87-ea73-4e11-9a80-c51dda69c734 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:45.097634 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-01104c87-ea73-4e11-9a80-c51dda69c734 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:45.242350 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-01104c87-ea73-4e11-9a80-c51dda69c734 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:45.254727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-01104c87-ea73-4e11-9a80-c51dda69c734 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1576 microversion: 2.1 time: 0.182832 Sep 02 05:32:45.256154 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 513/1026] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:32:45 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:32:45.285820 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-4180dce3-161c-4262-8e15-ed80eda5b14e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "POST /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.685428 Sep 02 05:32:45.286499 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 514/1027] 10.222.0.30 () {60 vars in 1323 bytes} [Fri Sep 2 05:32:44 2022] POST /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0/os-volume_attachments => generated 194 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:32:46.278043 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-47d5cf00-4304-40b8-bcde-21020921c421 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:46.279496 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-47d5cf00-4304-40b8-bcde-21020921c421 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:46.289527 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-47d5cf00-4304-40b8-bcde-21020921c421 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:46.294549 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-47d5cf00-4304-40b8-bcde-21020921c421 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:46.295383 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-47d5cf00-4304-40b8-bcde-21020921c421 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:46.296436 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-47d5cf00-4304-40b8-bcde-21020921c421 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:46.297124 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-47d5cf00-4304-40b8-bcde-21020921c421 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:46.299392 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-47d5cf00-4304-40b8-bcde-21020921c421 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:46.597235 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-47d5cf00-4304-40b8-bcde-21020921c421 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:46.609469 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-47d5cf00-4304-40b8-bcde-21020921c421 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1576 microversion: 2.1 time: 0.335793 Sep 02 05:32:46.610394 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 514/1028] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:32:46 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1576 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:32:47.098517 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-614e7f00-5123-4bc6-a5f8-44c2472d153e req-14135ef1-18c3-465a-bb10-3afc87be1d84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b554b98c-26dd-444a-9b8b-9c2a887babb4", "name": "network-vif-deleted", "tag": "2c730910-8785-43cc-9e4e-9d35a7b820c1"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:32:47.109289 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-614e7f00-5123-4bc6-a5f8-44c2472d153e req-14135ef1-18c3-465a-bb10-3afc87be1d84 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:47.109772 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-614e7f00-5123-4bc6-a5f8-44c2472d153e req-14135ef1-18c3-465a-bb10-3afc87be1d84 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:47.110415 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-614e7f00-5123-4bc6-a5f8-44c2472d153e req-14135ef1-18c3-465a-bb10-3afc87be1d84 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:47.123703 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-614e7f00-5123-4bc6-a5f8-44c2472d153e req-14135ef1-18c3-465a-bb10-3afc87be1d84 service nova] Creating event network-vif-deleted:2c730910-8785-43cc-9e4e-9d35a7b820c1 for instance b554b98c-26dd-444a-9b8b-9c2a887babb4 on hv-cinder-85391 Sep 02 05:32:47.129354 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-614e7f00-5123-4bc6-a5f8-44c2472d153e req-14135ef1-18c3-465a-bb10-3afc87be1d84 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035415 Sep 02 05:32:47.130545 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 515/1029] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:32:47.635383 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-78e99588-0683-49f3-8daf-9c6a9f07ea5d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:47.642489 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-78e99588-0683-49f3-8daf-9c6a9f07ea5d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:47.652449 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-78e99588-0683-49f3-8daf-9c6a9f07ea5d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:47.653176 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-78e99588-0683-49f3-8daf-9c6a9f07ea5d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:47.653854 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-78e99588-0683-49f3-8daf-9c6a9f07ea5d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:47.663213 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-78e99588-0683-49f3-8daf-9c6a9f07ea5d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:47.664097 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-78e99588-0683-49f3-8daf-9c6a9f07ea5d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:47.664893 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-78e99588-0683-49f3-8daf-9c6a9f07ea5d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:47.751642 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d8e87754-e9e0-4ac6-bec9-45f754020370 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:47.752265 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-d8e87754-e9e0-4ac6-bec9-45f754020370 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:47.759036 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d8e87754-e9e0-4ac6-bec9-45f754020370 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:47.759708 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d8e87754-e9e0-4ac6-bec9-45f754020370 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:47.760408 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d8e87754-e9e0-4ac6-bec9-45f754020370 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:47.761272 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d8e87754-e9e0-4ac6-bec9-45f754020370 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:47.761884 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d8e87754-e9e0-4ac6-bec9-45f754020370 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:47.762751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d8e87754-e9e0-4ac6-bec9-45f754020370 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:47.782807 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-78e99588-0683-49f3-8daf-9c6a9f07ea5d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:47.789679 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-d8e87754-e9e0-4ac6-bec9-45f754020370 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8/ips" status: 200 len: 151 microversion: 2.20 time: 0.042769 Sep 02 05:32:47.790551 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 516/1030] 10.222.0.30 () {60 vars in 1289 bytes} [Fri Sep 2 05:32:47 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 05:32:47.812691 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-78e99588-0683-49f3-8daf-9c6a9f07ea5d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1226 microversion: 2.1 time: 0.185313 Sep 02 05:32:47.820633 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 515/1031] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:32:47 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1226 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:32:48.834742 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-45d250d3-3fff-463d-8c08-7ae7350dadad tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:48.835348 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-45d250d3-3fff-463d-8c08-7ae7350dadad tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:48.842380 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-45d250d3-3fff-463d-8c08-7ae7350dadad tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:48.843115 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-45d250d3-3fff-463d-8c08-7ae7350dadad tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:48.843550 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-45d250d3-3fff-463d-8c08-7ae7350dadad tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:48.844520 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-45d250d3-3fff-463d-8c08-7ae7350dadad tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:48.844953 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-45d250d3-3fff-463d-8c08-7ae7350dadad tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:48.845373 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-45d250d3-3fff-463d-8c08-7ae7350dadad tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:48.926437 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-45d250d3-3fff-463d-8c08-7ae7350dadad tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:48.935424 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-45d250d3-3fff-463d-8c08-7ae7350dadad tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1226 microversion: 2.1 time: 0.104759 Sep 02 05:32:48.940163 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 517/1032] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:32:48 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:32:49.960174 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-22982cce-91a1-4f94-a32f-6eecca7e80bc tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:49.961025 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-22982cce-91a1-4f94-a32f-6eecca7e80bc tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:49.969806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-22982cce-91a1-4f94-a32f-6eecca7e80bc tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:49.970289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-22982cce-91a1-4f94-a32f-6eecca7e80bc tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:49.970722 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-22982cce-91a1-4f94-a32f-6eecca7e80bc tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:49.971411 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-22982cce-91a1-4f94-a32f-6eecca7e80bc tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:49.971863 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-22982cce-91a1-4f94-a32f-6eecca7e80bc tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:49.972348 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-22982cce-91a1-4f94-a32f-6eecca7e80bc tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:50.044243 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-22982cce-91a1-4f94-a32f-6eecca7e80bc tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:50.052314 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-22982cce-91a1-4f94-a32f-6eecca7e80bc tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1226 microversion: 2.1 time: 0.098770 Sep 02 05:32:50.052888 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 516/1033] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:32:49 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:32:51.074080 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-29a78b20-4b02-49c6-83b0-9c5943226082 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:51.074732 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-29a78b20-4b02-49c6-83b0-9c5943226082 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:51.081767 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-29a78b20-4b02-49c6-83b0-9c5943226082 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:51.082336 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-29a78b20-4b02-49c6-83b0-9c5943226082 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:51.082803 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-29a78b20-4b02-49c6-83b0-9c5943226082 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:51.083553 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-29a78b20-4b02-49c6-83b0-9c5943226082 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:51.084557 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-29a78b20-4b02-49c6-83b0-9c5943226082 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:51.085088 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-29a78b20-4b02-49c6-83b0-9c5943226082 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:51.152654 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-29a78b20-4b02-49c6-83b0-9c5943226082 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:51.160798 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-29a78b20-4b02-49c6-83b0-9c5943226082 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1226 microversion: 2.1 time: 0.091427 Sep 02 05:32:51.161364 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 518/1034] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:32:51 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:32:52.185490 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-9192848f-85ab-4fa6-bdaf-c6a00cf0746b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:52.186177 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-9192848f-85ab-4fa6-bdaf-c6a00cf0746b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:52.194153 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9192848f-85ab-4fa6-bdaf-c6a00cf0746b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:52.194720 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9192848f-85ab-4fa6-bdaf-c6a00cf0746b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:52.195232 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9192848f-85ab-4fa6-bdaf-c6a00cf0746b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:52.196036 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9192848f-85ab-4fa6-bdaf-c6a00cf0746b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:52.196608 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9192848f-85ab-4fa6-bdaf-c6a00cf0746b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:52.197108 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9192848f-85ab-4fa6-bdaf-c6a00cf0746b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:52.230609 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9192848f-85ab-4fa6-bdaf-c6a00cf0746b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:52.231016 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9192848f-85ab-4fa6-bdaf-c6a00cf0746b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:52.231448 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9192848f-85ab-4fa6-bdaf-c6a00cf0746b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:52.231886 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.objects.instance [None req-9192848f-85ab-4fa6-bdaf-c6a00cf0746b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lazy-loading 'fault' on Instance uuid b554b98c-26dd-444a-9b8b-9c2a887babb4 {{(pid=120449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:32:52.278135 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-9192848f-85ab-4fa6-bdaf-c6a00cf0746b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:52.291560 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-9192848f-85ab-4fa6-bdaf-c6a00cf0746b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1231 microversion: 2.1 time: 0.112561 Sep 02 05:32:52.294339 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 517/1035] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:32:52 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1231 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:32:52.944993 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-2bee7945-e774-4a08-8523-d3e00443c8f6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:32:52.945523 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-2bee7945-e774-4a08-8523-d3e00443c8f6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:52.952236 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2bee7945-e774-4a08-8523-d3e00443c8f6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:52.952726 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2bee7945-e774-4a08-8523-d3e00443c8f6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:52.953164 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2bee7945-e774-4a08-8523-d3e00443c8f6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:52.953864 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2bee7945-e774-4a08-8523-d3e00443c8f6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:52.954320 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2bee7945-e774-4a08-8523-d3e00443c8f6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:52.954745 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2bee7945-e774-4a08-8523-d3e00443c8f6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:52.977953 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.objects.instance [None req-2bee7945-e774-4a08-8523-d3e00443c8f6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lazy-loading 'flavor' on Instance uuid d862d87f-85bc-4970-97b5-af0ff1b6ebf8 {{(pid=120448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:32:53.160899 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-2bee7945-e774-4a08-8523-d3e00443c8f6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "POST /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8/action" status: 202 len: 0 microversion: 2.20 time: 0.219690 Sep 02 05:32:53.162422 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 519/1036] 10.222.0.30 () {62 vars in 1319 bytes} [Fri Sep 2 05:32:52 2022] POST /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 05:32:53.170494 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-3773c2b9-910e-4814-a0ae-d8462a5ef29a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:53.171047 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-3773c2b9-910e-4814-a0ae-d8462a5ef29a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:53.177165 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3773c2b9-910e-4814-a0ae-d8462a5ef29a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:53.177653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3773c2b9-910e-4814-a0ae-d8462a5ef29a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:53.178091 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3773c2b9-910e-4814-a0ae-d8462a5ef29a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:53.178780 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3773c2b9-910e-4814-a0ae-d8462a5ef29a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:53.179230 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3773c2b9-910e-4814-a0ae-d8462a5ef29a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:53.179654 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3773c2b9-910e-4814-a0ae-d8462a5ef29a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:53.315774 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-7297d1af-12d0-4f93-bd5c-59abffbeb46b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:53.316494 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-7297d1af-12d0-4f93-bd5c-59abffbeb46b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:53.320860 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-3773c2b9-910e-4814-a0ae-d8462a5ef29a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:53.323005 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7297d1af-12d0-4f93-bd5c-59abffbeb46b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:53.323567 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7297d1af-12d0-4f93-bd5c-59abffbeb46b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:53.323994 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7297d1af-12d0-4f93-bd5c-59abffbeb46b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:53.324725 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7297d1af-12d0-4f93-bd5c-59abffbeb46b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:53.325196 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7297d1af-12d0-4f93-bd5c-59abffbeb46b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:53.325671 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7297d1af-12d0-4f93-bd5c-59abffbeb46b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:53.330102 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-3773c2b9-910e-4814-a0ae-d8462a5ef29a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:53.331541 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-3773c2b9-910e-4814-a0ae-d8462a5ef29a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:53.332782 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-3773c2b9-910e-4814-a0ae-d8462a5ef29a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1722 microversion: 2.20 time: 0.166565 Sep 02 05:32:53.333326 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 518/1037] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:32:53 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:32:53.357128 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7297d1af-12d0-4f93-bd5c-59abffbeb46b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:53.357602 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7297d1af-12d0-4f93-bd5c-59abffbeb46b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:53.358030 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7297d1af-12d0-4f93-bd5c-59abffbeb46b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:53.358463 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.objects.instance [None req-7297d1af-12d0-4f93-bd5c-59abffbeb46b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lazy-loading 'fault' on Instance uuid b554b98c-26dd-444a-9b8b-9c2a887babb4 {{(pid=120448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:32:53.405877 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-7297d1af-12d0-4f93-bd5c-59abffbeb46b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:53.413855 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-7297d1af-12d0-4f93-bd5c-59abffbeb46b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1231 microversion: 2.1 time: 0.102471 Sep 02 05:32:53.414410 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 520/1038] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:32:53 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1231 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:32:54.359668 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-0ea18e74-9a0d-41a2-bcc5-4814bf66be03 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:54.360560 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-0ea18e74-9a0d-41a2-bcc5-4814bf66be03 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:54.371847 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0ea18e74-9a0d-41a2-bcc5-4814bf66be03 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:54.372716 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0ea18e74-9a0d-41a2-bcc5-4814bf66be03 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:54.373152 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0ea18e74-9a0d-41a2-bcc5-4814bf66be03 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:54.373833 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0ea18e74-9a0d-41a2-bcc5-4814bf66be03 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:54.374278 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0ea18e74-9a0d-41a2-bcc5-4814bf66be03 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:54.374821 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0ea18e74-9a0d-41a2-bcc5-4814bf66be03 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:54.434819 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-0247a343-6b00-4d01-8831-35a95889a064 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:54.435573 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-0247a343-6b00-4d01-8831-35a95889a064 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:54.441989 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0247a343-6b00-4d01-8831-35a95889a064 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:54.442469 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0247a343-6b00-4d01-8831-35a95889a064 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:54.442895 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0247a343-6b00-4d01-8831-35a95889a064 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:54.443576 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0247a343-6b00-4d01-8831-35a95889a064 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:54.444027 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0247a343-6b00-4d01-8831-35a95889a064 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:54.444465 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0247a343-6b00-4d01-8831-35a95889a064 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:54.463454 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:32:54.479253 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0247a343-6b00-4d01-8831-35a95889a064 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:54.479736 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0247a343-6b00-4d01-8831-35a95889a064 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:54.480223 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0247a343-6b00-4d01-8831-35a95889a064 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:54.480624 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.objects.instance [None req-0247a343-6b00-4d01-8831-35a95889a064 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lazy-loading 'fault' on Instance uuid b554b98c-26dd-444a-9b8b-9c2a887babb4 {{(pid=120448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:32:54.533333 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-0247a343-6b00-4d01-8831-35a95889a064 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:54.536596 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-0ea18e74-9a0d-41a2-bcc5-4814bf66be03 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:54.541667 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-0247a343-6b00-4d01-8831-35a95889a064 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1231 microversion: 2.1 time: 0.110718 Sep 02 05:32:54.542204 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 521/1039] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:32:54 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1231 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:32:54.545895 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-0ea18e74-9a0d-41a2-bcc5-4814bf66be03 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:54.547349 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-0ea18e74-9a0d-41a2-bcc5-4814bf66be03 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:54.548568 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-0ea18e74-9a0d-41a2-bcc5-4814bf66be03 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1722 microversion: 2.20 time: 0.195610 Sep 02 05:32:54.549267 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 519/1040] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:32:54 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:32:55.566467 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-4924222f-34e4-4d6c-9593-0a10566dddfe tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:55.567598 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-4924222f-34e4-4d6c-9593-0a10566dddfe tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:55.575522 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-f11ace66-4ace-4802-99c4-7c6180b941cf tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:55.576533 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-f11ace66-4ace-4802-99c4-7c6180b941cf tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:55.578546 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4924222f-34e4-4d6c-9593-0a10566dddfe tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:55.578957 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4924222f-34e4-4d6c-9593-0a10566dddfe tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:55.579394 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4924222f-34e4-4d6c-9593-0a10566dddfe tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:55.580448 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4924222f-34e4-4d6c-9593-0a10566dddfe tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:55.580589 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4924222f-34e4-4d6c-9593-0a10566dddfe tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:55.581034 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4924222f-34e4-4d6c-9593-0a10566dddfe tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:55.583682 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f11ace66-4ace-4802-99c4-7c6180b941cf tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:55.584151 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f11ace66-4ace-4802-99c4-7c6180b941cf tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:55.584624 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f11ace66-4ace-4802-99c4-7c6180b941cf tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:55.585314 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f11ace66-4ace-4802-99c4-7c6180b941cf tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:55.585764 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f11ace66-4ace-4802-99c4-7c6180b941cf tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:55.586185 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f11ace66-4ace-4802-99c4-7c6180b941cf tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:55.614170 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4924222f-34e4-4d6c-9593-0a10566dddfe tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:55.614646 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4924222f-34e4-4d6c-9593-0a10566dddfe tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:55.615085 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4924222f-34e4-4d6c-9593-0a10566dddfe tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:55.615526 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.objects.instance [None req-4924222f-34e4-4d6c-9593-0a10566dddfe tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lazy-loading 'fault' on Instance uuid b554b98c-26dd-444a-9b8b-9c2a887babb4 {{(pid=120448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:32:55.672317 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-4924222f-34e4-4d6c-9593-0a10566dddfe tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:55.680516 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-4924222f-34e4-4d6c-9593-0a10566dddfe tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1231 microversion: 2.1 time: 0.120553 Sep 02 05:32:55.681112 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 522/1041] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:32:55 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1231 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:32:55.741947 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-f11ace66-4ace-4802-99c4-7c6180b941cf tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:55.750482 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-f11ace66-4ace-4802-99c4-7c6180b941cf tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:55.752261 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-f11ace66-4ace-4802-99c4-7c6180b941cf tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:55.753976 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-f11ace66-4ace-4802-99c4-7c6180b941cf tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1722 microversion: 2.20 time: 0.184723 Sep 02 05:32:55.754969 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 520/1042] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:32:55 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:32:56.701962 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f181a19b-7dbb-48c0-8b7e-64bae373a1cc tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:56.702596 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f181a19b-7dbb-48c0-8b7e-64bae373a1cc tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:56.712451 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f181a19b-7dbb-48c0-8b7e-64bae373a1cc tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:56.713065 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f181a19b-7dbb-48c0-8b7e-64bae373a1cc tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:56.713575 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f181a19b-7dbb-48c0-8b7e-64bae373a1cc tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:56.714561 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f181a19b-7dbb-48c0-8b7e-64bae373a1cc tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:56.715159 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f181a19b-7dbb-48c0-8b7e-64bae373a1cc tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:56.715710 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f181a19b-7dbb-48c0-8b7e-64bae373a1cc tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:56.750592 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f181a19b-7dbb-48c0-8b7e-64bae373a1cc tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:56.751081 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f181a19b-7dbb-48c0-8b7e-64bae373a1cc tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:56.751655 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f181a19b-7dbb-48c0-8b7e-64bae373a1cc tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:56.751955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.objects.instance [None req-f181a19b-7dbb-48c0-8b7e-64bae373a1cc tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lazy-loading 'fault' on Instance uuid b554b98c-26dd-444a-9b8b-9c2a887babb4 {{(pid=120448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:32:56.785816 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-2743c2fa-bbff-4e2d-8b1e-2a94477fce31 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:56.787155 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-2743c2fa-bbff-4e2d-8b1e-2a94477fce31 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:56.793967 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2743c2fa-bbff-4e2d-8b1e-2a94477fce31 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:56.794420 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2743c2fa-bbff-4e2d-8b1e-2a94477fce31 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:56.795601 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2743c2fa-bbff-4e2d-8b1e-2a94477fce31 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:56.796516 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2743c2fa-bbff-4e2d-8b1e-2a94477fce31 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:56.796967 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2743c2fa-bbff-4e2d-8b1e-2a94477fce31 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:56.797386 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2743c2fa-bbff-4e2d-8b1e-2a94477fce31 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:56.797962 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f181a19b-7dbb-48c0-8b7e-64bae373a1cc tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:56.807471 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f181a19b-7dbb-48c0-8b7e-64bae373a1cc tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 200 len: 1231 microversion: 2.1 time: 0.110178 Sep 02 05:32:56.808419 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 523/1043] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:32:56 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 1231 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:32:56.939032 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-2743c2fa-bbff-4e2d-8b1e-2a94477fce31 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:56.947405 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-2743c2fa-bbff-4e2d-8b1e-2a94477fce31 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:56.948897 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-2743c2fa-bbff-4e2d-8b1e-2a94477fce31 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:56.950035 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-2743c2fa-bbff-4e2d-8b1e-2a94477fce31 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1722 microversion: 2.20 time: 0.168160 Sep 02 05:32:56.950590 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 521/1044] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:32:56 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:32:57.391073 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-1458ada5-056f-4fca-99ea-557cba115992 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27447b99-f3c2-4fda-b90e-d4db1ca099d8"}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:32:57.393452 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-1458ada5-056f-4fca-99ea-557cba115992 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:57.399464 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1458ada5-056f-4fca-99ea-557cba115992 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:57.399940 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1458ada5-056f-4fca-99ea-557cba115992 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:57.400396 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1458ada5-056f-4fca-99ea-557cba115992 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:57.401075 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1458ada5-056f-4fca-99ea-557cba115992 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:57.401521 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1458ada5-056f-4fca-99ea-557cba115992 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:57.401932 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1458ada5-056f-4fca-99ea-557cba115992 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:57.480844 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.wsgi [None req-1458ada5-056f-4fca-99ea-557cba115992 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] HTTP exception thrown: Invalid volume: volume 27447b99-f3c2-4fda-b90e-d4db1ca099d8 is already attached to instances: 1d783711-2893-40ce-8b8b-800090dd1ef0 Sep 02 05:32:57.482677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-1458ada5-056f-4fca-99ea-557cba115992 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Request method failure captured: Sep 02 05:32:57.482677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: request: POST /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0/os-volume_attachments HTTP/1.1 Sep 02 05:32:57.482677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept: application/json Sep 02 05:32:57.482677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept-Encoding: identity Sep 02 05:32:57.482677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Connection: close Sep 02 05:32:57.482677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Length: 74 Sep 02 05:32:57.482677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Type: application/json Sep 02 05:32:57.482677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Host: 10.222.0.30 Sep 02 05:32:57.482677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Openstack-System-Scope: None Sep 02 05:32:57.482677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: User-Agent: python-urllib3/1.26.12 Sep 02 05:32:57.482677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Auth-Token: gAAAAABjEZM9sMpwUr9qoyGfMjDaBJ8P6YvBPQ-f9EMy1v-mwCEwm2r_bgyQO13MJw9PzuA9JX3XTWqubrdQgU1a6BCBynzOqQh_kSQW7GnBay9PYEuOinJQJVybarMVc5DymGEpqCE1wXufVXEiHhxifOsWWijBJ0RmMiTE9rG9XyLkwahJIcQ Sep 02 05:32:57.482677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Id: None Sep 02 05:32:57.482677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Name: None Sep 02 05:32:57.482677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Identity-Status: Confirmed Sep 02 05:32:57.482677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Is-Admin-Project: True Sep 02 05:32:57.482677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Id: default Sep 02 05:32:57.482677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Name: Default Sep 02 05:32:57.482677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Id: 0847ca942df54b659e8723463ab72c65 Sep 02 05:32:57.482677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Name: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:32:57.482677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Role: member,reader Sep 02 05:32:57.482677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Roles: member,reader Sep 02 05:32:57.484393 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0847ca942df54b659e8723463ab72c65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0847ca942df54b659e8723463ab72c65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0847ca942df54b659e8723463ab72c65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0847ca942df54b659e8723463ab72c65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:32:57.484393 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:32:57.484393 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Id: 0847ca942df54b659e8723463ab72c65 Sep 02 05:32:57.484393 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:32:57.484393 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User: tempest-AttachVolumeNegativeTest-1685577678-project Sep 02 05:32:57.484393 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Id: default Sep 02 05:32:57.484393 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Name: Default Sep 02 05:32:57.484393 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Id: ee1a3027b52f4b46bc5cff18f9cd0b02 Sep 02 05:32:57.484393 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Name: tempest-AttachVolumeNegativeTest-1685577678-project Sep 02 05:32:57.484393 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Sep 02 05:32:57.484393 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {"volumeAttachment": {"volumeId": "27447b99-f3c2-4fda-b90e-d4db1ca099d8"}} Sep 02 05:32:57.484393 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: method: > Sep 02 05:32:57.485370 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: exception: Invalid volume: volume 27447b99-f3c2-4fda-b90e-d4db1ca099d8 is already attached to instances: 1d783711-2893-40ce-8b8b-800090dd1ef0 Sep 02 05:32:57.485370 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: action_args: {'server_id': '1d783711-2893-40ce-8b8b-800090dd1ef0', 'body': {'volumeAttachment': {'volumeId': '27447b99-f3c2-4fda-b90e-d4db1ca099d8'}}} Sep 02 05:32:57.485370 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:32:57.485370 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:57.485370 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 02 05:32:57.485370 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 02 05:32:57.485370 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 05:32:57.485370 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 05:32:57.485370 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 02 05:32:57.485370 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 02 05:32:57.485370 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 02 05:32:57.485370 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 02 05:32:57.485370 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 02 05:32:57.485370 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 02 05:32:57.485370 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 27447b99-f3c2-4fda-b90e-d4db1ca099d8 is already attached to instances: 1d783711-2893-40ce-8b8b-800090dd1ef0 Sep 02 05:32:57.485370 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:57.485370 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:57.485370 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:57.485370 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:57.487434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:32:57.487434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:32:57.487434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:32:57.487434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:32:57.487434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:32:57.487434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:32:57.487434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 05:32:57.487434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 05:32:57.487434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 05:32:57.487434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 05:32:57.487434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 05:32:57.487434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 05:32:57.487434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 02 05:32:57.487434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 02 05:32:57.487434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 27447b99-f3c2-4fda-b90e-d4db1ca099d8 is already attached to instances: 1d783711-2893-40ce-8b8b-800090dd1ef0 Sep 02 05:32:57.487434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:57.487434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:57.487434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:57.487434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:57.487434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:32:57.489108 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:32:57.489108 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:32:57.489108 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:32:57.489108 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 27447b99-f3c2-4fda-b90e-d4db1ca099d8 is already attached to instances: 1d783711-2893-40ce-8b8b-800090dd1ef0 Sep 02 05:32:57.489108 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:32:57.489108 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-1458ada5-056f-4fca-99ea-557cba115992 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Returning 400 to user: Invalid volume: volume 27447b99-f3c2-4fda-b90e-d4db1ca099d8 is already attached to instances: 1d783711-2893-40ce-8b8b-800090dd1ef0 {{(pid=120448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:32:57.489108 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-1458ada5-056f-4fca-99ea-557cba115992 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "POST /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097237 Sep 02 05:32:57.489108 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 524/1045] 10.222.0.30 () {60 vars in 1323 bytes} [Fri Sep 2 05:32:57 2022] POST /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 05:32:57.550132 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-9fa71d90-5fe7-4193-a9a0-10e0d21f8400 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:57.550649 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-9fa71d90-5fe7-4193-a9a0-10e0d21f8400 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:57.556735 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9fa71d90-5fe7-4193-a9a0-10e0d21f8400 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:57.557220 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9fa71d90-5fe7-4193-a9a0-10e0d21f8400 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:57.557658 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9fa71d90-5fe7-4193-a9a0-10e0d21f8400 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:57.558339 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9fa71d90-5fe7-4193-a9a0-10e0d21f8400 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:57.558791 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9fa71d90-5fe7-4193-a9a0-10e0d21f8400 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:57.559210 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9fa71d90-5fe7-4193-a9a0-10e0d21f8400 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:57.641895 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.objects.instance [None req-9fa71d90-5fe7-4193-a9a0-10e0d21f8400 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lazy-loading 'services' on Instance uuid 1d783711-2893-40ce-8b8b-800090dd1ef0 {{(pid=120449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:32:57.645597 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:32:57.722138 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-9fa71d90-5fe7-4193-a9a0-10e0d21f8400 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0/os-volume_attachments/27447b99-f3c2-4fda-b90e-d4db1ca099d8" status: 202 len: 0 microversion: 2.1 time: 0.175438 Sep 02 05:32:57.722840 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 522/1046] 10.222.0.30 () {58 vars in 1416 bytes} [Fri Sep 2 05:32:57 2022] DELETE /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0/os-volume_attachments/27447b99-f3c2-4fda-b90e-d4db1ca099d8 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:32:57.731356 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-8ce5c0b5-9d44-4f43-854d-b99f2da743dc tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:57.733727 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-8ce5c0b5-9d44-4f43-854d-b99f2da743dc tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:57.741820 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8ce5c0b5-9d44-4f43-854d-b99f2da743dc tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:57.742343 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8ce5c0b5-9d44-4f43-854d-b99f2da743dc tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:57.742810 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8ce5c0b5-9d44-4f43-854d-b99f2da743dc tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:57.743517 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8ce5c0b5-9d44-4f43-854d-b99f2da743dc tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:57.744049 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8ce5c0b5-9d44-4f43-854d-b99f2da743dc tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:57.744504 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8ce5c0b5-9d44-4f43-854d-b99f2da743dc tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:57.777860 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-8ce5c0b5-9d44-4f43-854d-b99f2da743dc tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050396 Sep 02 05:32:57.778447 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 525/1047] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Sep 2 05:32:57 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:32:57.829099 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ce600467-94de-4d83-a362-e30bd27e9ebd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:57.829791 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-ce600467-94de-4d83-a362-e30bd27e9ebd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:57.836622 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ce600467-94de-4d83-a362-e30bd27e9ebd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:57.837084 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ce600467-94de-4d83-a362-e30bd27e9ebd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:57.837517 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ce600467-94de-4d83-a362-e30bd27e9ebd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:57.838200 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ce600467-94de-4d83-a362-e30bd27e9ebd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:57.838652 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ce600467-94de-4d83-a362-e30bd27e9ebd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:57.839080 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ce600467-94de-4d83-a362-e30bd27e9ebd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:57.852318 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.wsgi [None req-ce600467-94de-4d83-a362-e30bd27e9ebd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] HTTP exception thrown: Instance b554b98c-26dd-444a-9b8b-9c2a887babb4 could not be found. Sep 02 05:32:57.854188 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ce600467-94de-4d83-a362-e30bd27e9ebd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Request method failure captured: Sep 02 05:32:57.854188 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: request: GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 HTTP/1.1 Sep 02 05:32:57.854188 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept: application/json Sep 02 05:32:57.854188 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept-Encoding: identity Sep 02 05:32:57.854188 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Connection: close Sep 02 05:32:57.854188 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Length: 0 Sep 02 05:32:57.854188 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Type: application/json Sep 02 05:32:57.854188 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Host: 10.222.0.30 Sep 02 05:32:57.854188 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Openstack-System-Scope: None Sep 02 05:32:57.854188 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: User-Agent: python-urllib3/1.26.12 Sep 02 05:32:57.854188 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Auth-Token: gAAAAABjEZSTBTGQ3NVB1DgFqU7aDU3PsJl1eB73xA8C4sxX3Yzp9lN9q4Fn1_6VUb5VftvaMOi3pv9-9CAFhNSwB5989aAkyvaKPJ08dIfAo3VdsYLWahXv8rquD4ZDiyEsYVfIw8YUO0D8djrMRmc4NOuY87Hl-VGfm5xDUAOdU04XyvTT_eE Sep 02 05:32:57.854188 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Id: None Sep 02 05:32:57.854188 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Name: None Sep 02 05:32:57.854188 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Identity-Status: Confirmed Sep 02 05:32:57.854188 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Is-Admin-Project: True Sep 02 05:32:57.854188 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Id: default Sep 02 05:32:57.854188 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Name: Default Sep 02 05:32:57.854188 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Id: e45a42292fe94dccaa14ba6bc41ded09 Sep 02 05:32:57.854188 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Name: tempest-TestVolumeBootPattern-1103430737 Sep 02 05:32:57.854188 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Role: member,reader Sep 02 05:32:57.854188 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Roles: member,reader Sep 02 05:32:57.855779 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e45a42292fe94dccaa14ba6bc41ded09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45a42292fe94dccaa14ba6bc41ded09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e45a42292fe94dccaa14ba6bc41ded09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45a42292fe94dccaa14ba6bc41ded09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:32:57.855779 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant: tempest-TestVolumeBootPattern-1103430737 Sep 02 05:32:57.855779 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Id: e45a42292fe94dccaa14ba6bc41ded09 Sep 02 05:32:57.855779 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Name: tempest-TestVolumeBootPattern-1103430737 Sep 02 05:32:57.855779 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User: tempest-TestVolumeBootPattern-1103430737-project Sep 02 05:32:57.855779 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Id: default Sep 02 05:32:57.855779 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Name: Default Sep 02 05:32:57.855779 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Id: 03812cff7628436f952ea5be41420297 Sep 02 05:32:57.855779 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Name: tempest-TestVolumeBootPattern-1103430737-project Sep 02 05:32:57.855779 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: method: > Sep 02 05:32:57.855779 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: exception: Instance b554b98c-26dd-444a-9b8b-9c2a887babb4 could not be found. Sep 02 05:32:57.855779 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: action_args: {'id': 'b554b98c-26dd-444a-9b8b-9c2a887babb4'} Sep 02 05:32:57.856783 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:32:57.856783 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:57.856783 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:32:57.856783 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:32:57.856783 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:32:57.856783 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:32:57.856783 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:32:57.856783 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:32:57.856783 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:32:57.856783 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:32:57.856783 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b554b98c-26dd-444a-9b8b-9c2a887babb4 could not be found. Sep 02 05:32:57.856783 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:57.856783 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:57.856783 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:57.856783 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:57.856783 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:32:57.856783 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:32:57.856783 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:32:57.856783 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:32:57.856783 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:32:57.858303 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:32:57.858303 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:32:57.858303 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:32:57.858303 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:32:57.858303 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:32:57.858303 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:32:57.858303 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:32:57.858303 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b554b98c-26dd-444a-9b8b-9c2a887babb4 could not be found. Sep 02 05:32:57.858303 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:57.858303 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:32:57.858303 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:57.858303 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:32:57.858303 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:32:57.858303 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:32:57.858303 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:32:57.858303 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:32:57.858303 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b554b98c-26dd-444a-9b8b-9c2a887babb4 could not be found. Sep 02 05:32:57.858303 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:32:57.859744 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ce600467-94de-4d83-a362-e30bd27e9ebd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Returning 404 to user: Instance b554b98c-26dd-444a-9b8b-9c2a887babb4 could not be found. {{(pid=120449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:32:57.859744 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-ce600467-94de-4d83-a362-e30bd27e9ebd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 404 len: 111 microversion: 2.1 time: 0.030876 Sep 02 05:32:57.859744 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 523/1048] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:32:57 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:32:57.963508 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-2cf241ea-587d-4ed7-bd22-3243cb32ce43 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-882590651", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1280367057", "security_groups": [{"name": "tempest-secgroup-smoke-609092212"}], "block_device_mapping_v2": [{"uuid": "cd6b57c5-6b02-48fc-b0a1-fb8bc2e67d9b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8d5e3ffd-1ee0-4cbd-8c2c-83ff33c46dbd"}]}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:32:57.974667 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-7ecaf350-7d92-49c2-b189-20334ce710c1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:57.975286 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-7ecaf350-7d92-49c2-b189-20334ce710c1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:57.981274 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7ecaf350-7d92-49c2-b189-20334ce710c1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:57.981794 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7ecaf350-7d92-49c2-b189-20334ce710c1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:57.982259 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7ecaf350-7d92-49c2-b189-20334ce710c1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:57.982969 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7ecaf350-7d92-49c2-b189-20334ce710c1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:57.983522 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7ecaf350-7d92-49c2-b189-20334ce710c1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:57.983985 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7ecaf350-7d92-49c2-b189-20334ce710c1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:58.131535 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.network.neutron [None req-2cf241ea-587d-4ed7-bd22-3243cb32ce43 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] validate_networks() for [('8d5e3ffd-1ee0-4cbd-8c2c-83ff33c46dbd', None, None, None, None, None)] {{(pid=120448) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 05:32:58.215863 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-7ecaf350-7d92-49c2-b189-20334ce710c1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:58.224482 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-7ecaf350-7d92-49c2-b189-20334ce710c1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:58.226319 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-7ecaf350-7d92-49c2-b189-20334ce710c1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:58.227490 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-7ecaf350-7d92-49c2-b189-20334ce710c1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1722 microversion: 2.20 time: 0.256682 Sep 02 05:32:58.228497 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 524/1049] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:32:57 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:32:58.593793 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-2cf241ea-587d-4ed7-bd22-3243cb32ce43 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Flavor limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 05:32:58.594217 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-2cf241ea-587d-4ed7-bd22-3243cb32ce43 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Image limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 05:32:58.594689 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-2cf241ea-587d-4ed7-bd22-3243cb32ce43 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Flavor pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 05:32:58.595093 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-2cf241ea-587d-4ed7-bd22-3243cb32ce43 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Image pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 05:32:58.595503 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-2cf241ea-587d-4ed7-bd22-3243cb32ce43 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 05:32:58.605246 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2cf241ea-587d-4ed7-bd22-3243cb32ce43 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:58.605770 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2cf241ea-587d-4ed7-bd22-3243cb32ce43 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:58.606199 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2cf241ea-587d-4ed7-bd22-3243cb32ce43 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:58.606926 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2cf241ea-587d-4ed7-bd22-3243cb32ce43 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:58.607378 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2cf241ea-587d-4ed7-bd22-3243cb32ce43 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:58.607820 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2cf241ea-587d-4ed7-bd22-3243cb32ce43 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:58.625129 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-2cf241ea-587d-4ed7-bd22-3243cb32ce43 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Getting quotas for project e45a42292fe94dccaa14ba6bc41ded09. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:32:58.629307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-2cf241ea-587d-4ed7-bd22-3243cb32ce43 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Getting quotas for user 03812cff7628436f952ea5be41420297 and project e45a42292fe94dccaa14ba6bc41ded09. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:32:58.686862 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-2cf241ea-587d-4ed7-bd22-3243cb32ce43 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Going to run 1 instances... {{(pid=120448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 05:32:58.689089 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-2cf241ea-587d-4ed7-bd22-3243cb32ce43 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: 7b97865b-0582-4cf4-a4a7-d7aaa655251d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cd6b57c5-6b02-48fc-b0a1-fb8bc2e67d9b',volume_size=None,volume_type=None)] {{(pid=120448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 05:32:58.790423 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-373ada95-1634-4358-b7eb-a23b2823c48e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:58.792917 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-373ada95-1634-4358-b7eb-a23b2823c48e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:58.799192 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-373ada95-1634-4358-b7eb-a23b2823c48e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:58.799667 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-373ada95-1634-4358-b7eb-a23b2823c48e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:58.800354 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-373ada95-1634-4358-b7eb-a23b2823c48e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:58.801099 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-373ada95-1634-4358-b7eb-a23b2823c48e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:58.801715 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-373ada95-1634-4358-b7eb-a23b2823c48e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:58.802171 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-373ada95-1634-4358-b7eb-a23b2823c48e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:58.827462 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-2cf241ea-587d-4ed7-bd22-3243cb32ce43 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.867811 Sep 02 05:32:58.828416 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 526/1050] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Sep 2 05:32:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 05:32:58.833675 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-373ada95-1634-4358-b7eb-a23b2823c48e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047211 Sep 02 05:32:58.834535 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 525/1051] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Sep 2 05:32:58 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:32:58.847576 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-634d1677-fa19-44c3-9a35-de628665d8d2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:58.850983 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-634d1677-fa19-44c3-9a35-de628665d8d2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: 7b97865b-0582-4cf4-a4a7-d7aaa655251d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:58.909607 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-634d1677-fa19-44c3-9a35-de628665d8d2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:58.918000 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-634d1677-fa19-44c3-9a35-de628665d8d2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d" status: 200 len: 1094 microversion: 2.1 time: 0.081986 Sep 02 05:32:58.918947 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 527/1052] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:32:58 2022] GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d => generated 1094 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:32:59.252425 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-e712c037-eb28-4575-81d2-36a7ee444940 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:59.253173 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-e712c037-eb28-4575-81d2-36a7ee444940 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:59.259962 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e712c037-eb28-4575-81d2-36a7ee444940 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:59.260475 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e712c037-eb28-4575-81d2-36a7ee444940 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:59.260905 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e712c037-eb28-4575-81d2-36a7ee444940 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:59.261657 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e712c037-eb28-4575-81d2-36a7ee444940 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:59.262177 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e712c037-eb28-4575-81d2-36a7ee444940 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:59.262679 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e712c037-eb28-4575-81d2-36a7ee444940 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:59.407742 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e712c037-eb28-4575-81d2-36a7ee444940 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:59.416693 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e712c037-eb28-4575-81d2-36a7ee444940 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:59.418305 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e712c037-eb28-4575-81d2-36a7ee444940 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:32:59.419355 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-e712c037-eb28-4575-81d2-36a7ee444940 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1722 microversion: 2.20 time: 0.171692 Sep 02 05:32:59.420084 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 526/1053] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:32:59 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:32:59.850791 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-1b19ca33-f55b-44c5-96f1-194ca37ee47e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:59.854556 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-1b19ca33-f55b-44c5-96f1-194ca37ee47e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:59.864361 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1b19ca33-f55b-44c5-96f1-194ca37ee47e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:59.864844 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1b19ca33-f55b-44c5-96f1-194ca37ee47e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:59.865301 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1b19ca33-f55b-44c5-96f1-194ca37ee47e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:59.865974 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1b19ca33-f55b-44c5-96f1-194ca37ee47e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:59.866431 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1b19ca33-f55b-44c5-96f1-194ca37ee47e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:59.866862 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1b19ca33-f55b-44c5-96f1-194ca37ee47e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:59.896580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-1b19ca33-f55b-44c5-96f1-194ca37ee47e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053052 Sep 02 05:32:59.897133 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 528/1054] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Sep 2 05:32:59 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:32:59.938799 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-cb0ae930-2827-4df8-8d65-df9b626d076f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:32:59.939382 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-cb0ae930-2827-4df8-8d65-df9b626d076f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: 7b97865b-0582-4cf4-a4a7-d7aaa655251d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:32:59.945769 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cb0ae930-2827-4df8-8d65-df9b626d076f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:59.946251 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cb0ae930-2827-4df8-8d65-df9b626d076f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:59.946680 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cb0ae930-2827-4df8-8d65-df9b626d076f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:32:59.947360 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cb0ae930-2827-4df8-8d65-df9b626d076f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:32:59.947810 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cb0ae930-2827-4df8-8d65-df9b626d076f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:32:59.948262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cb0ae930-2827-4df8-8d65-df9b626d076f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:00.014209 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-cb0ae930-2827-4df8-8d65-df9b626d076f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:00.022144 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-cb0ae930-2827-4df8-8d65-df9b626d076f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d" status: 200 len: 1144 microversion: 2.1 time: 0.087252 Sep 02 05:33:00.022700 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 527/1055] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:32:59 2022] GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:00.447090 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-8babefc3-b15a-4e0b-9bb7-6295698371b5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:00.448090 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-8babefc3-b15a-4e0b-9bb7-6295698371b5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:00.458298 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8babefc3-b15a-4e0b-9bb7-6295698371b5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:00.459105 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8babefc3-b15a-4e0b-9bb7-6295698371b5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:00.459787 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8babefc3-b15a-4e0b-9bb7-6295698371b5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:00.461016 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8babefc3-b15a-4e0b-9bb7-6295698371b5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:00.461769 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8babefc3-b15a-4e0b-9bb7-6295698371b5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:00.462475 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8babefc3-b15a-4e0b-9bb7-6295698371b5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:00.602654 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-8babefc3-b15a-4e0b-9bb7-6295698371b5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:00.613859 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-8babefc3-b15a-4e0b-9bb7-6295698371b5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:00.615288 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-8babefc3-b15a-4e0b-9bb7-6295698371b5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:00.616901 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-8babefc3-b15a-4e0b-9bb7-6295698371b5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1722 microversion: 2.20 time: 0.175973 Sep 02 05:33:00.618029 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 529/1056] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:00 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:00.916342 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-61cce5fe-9f18-4adc-b02a-a52b1da4877d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:00.920010 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-61cce5fe-9f18-4adc-b02a-a52b1da4877d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:00.927489 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-61cce5fe-9f18-4adc-b02a-a52b1da4877d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:00.927971 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-61cce5fe-9f18-4adc-b02a-a52b1da4877d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:00.928443 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-61cce5fe-9f18-4adc-b02a-a52b1da4877d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:00.929139 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-61cce5fe-9f18-4adc-b02a-a52b1da4877d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:00.929588 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-61cce5fe-9f18-4adc-b02a-a52b1da4877d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:00.930010 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-61cce5fe-9f18-4adc-b02a-a52b1da4877d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:00.960520 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-61cce5fe-9f18-4adc-b02a-a52b1da4877d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051512 Sep 02 05:33:00.961137 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 528/1057] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Sep 2 05:33:00 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:33:01.050851 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-e1569031-8887-4db7-a2da-48e28be504c8 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:01.051855 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-e1569031-8887-4db7-a2da-48e28be504c8 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: 7b97865b-0582-4cf4-a4a7-d7aaa655251d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:01.062644 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e1569031-8887-4db7-a2da-48e28be504c8 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:01.063128 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e1569031-8887-4db7-a2da-48e28be504c8 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:01.063525 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e1569031-8887-4db7-a2da-48e28be504c8 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:01.064280 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e1569031-8887-4db7-a2da-48e28be504c8 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:01.064733 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e1569031-8887-4db7-a2da-48e28be504c8 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:01.065150 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e1569031-8887-4db7-a2da-48e28be504c8 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:01.129104 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-e1569031-8887-4db7-a2da-48e28be504c8 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:01.137189 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-e1569031-8887-4db7-a2da-48e28be504c8 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d" status: 200 len: 1136 microversion: 2.1 time: 0.095555 Sep 02 05:33:01.137761 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 530/1058] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:01 2022] GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d => generated 1136 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:01.659036 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-064e9715-e579-459b-8889-4a3125d268b1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:01.660079 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-064e9715-e579-459b-8889-4a3125d268b1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:01.670163 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-064e9715-e579-459b-8889-4a3125d268b1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:01.670958 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-064e9715-e579-459b-8889-4a3125d268b1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:01.671640 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-064e9715-e579-459b-8889-4a3125d268b1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:01.672365 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-064e9715-e579-459b-8889-4a3125d268b1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:01.672816 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-064e9715-e579-459b-8889-4a3125d268b1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:01.673237 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-064e9715-e579-459b-8889-4a3125d268b1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:01.809252 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-064e9715-e579-459b-8889-4a3125d268b1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:01.818695 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-064e9715-e579-459b-8889-4a3125d268b1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:01.820154 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-064e9715-e579-459b-8889-4a3125d268b1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:01.821320 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-064e9715-e579-459b-8889-4a3125d268b1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1722 microversion: 2.20 time: 0.168775 Sep 02 05:33:01.821880 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 529/1059] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:01 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:01.977729 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-7b27531e-00c5-473e-82d7-fda3cebdedf9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:01.981191 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-7b27531e-00c5-473e-82d7-fda3cebdedf9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:01.991705 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7b27531e-00c5-473e-82d7-fda3cebdedf9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:01.992583 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7b27531e-00c5-473e-82d7-fda3cebdedf9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:01.993310 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7b27531e-00c5-473e-82d7-fda3cebdedf9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:01.994451 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7b27531e-00c5-473e-82d7-fda3cebdedf9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:01.995204 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7b27531e-00c5-473e-82d7-fda3cebdedf9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:01.995950 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7b27531e-00c5-473e-82d7-fda3cebdedf9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:02.028714 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-7b27531e-00c5-473e-82d7-fda3cebdedf9 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057999 Sep 02 05:33:02.029266 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 531/1060] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Sep 2 05:33:01 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:33:02.160762 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-050ac150-0779-4022-acb0-e1c6b261a5f9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:02.161524 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-050ac150-0779-4022-acb0-e1c6b261a5f9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: 7b97865b-0582-4cf4-a4a7-d7aaa655251d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:02.170444 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-050ac150-0779-4022-acb0-e1c6b261a5f9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:02.171080 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-050ac150-0779-4022-acb0-e1c6b261a5f9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:02.171672 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-050ac150-0779-4022-acb0-e1c6b261a5f9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:02.172397 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-050ac150-0779-4022-acb0-e1c6b261a5f9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:02.172846 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-050ac150-0779-4022-acb0-e1c6b261a5f9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:02.173284 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-050ac150-0779-4022-acb0-e1c6b261a5f9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:02.236476 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-050ac150-0779-4022-acb0-e1c6b261a5f9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:02.244392 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-050ac150-0779-4022-acb0-e1c6b261a5f9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d" status: 200 len: 1136 microversion: 2.1 time: 0.088986 Sep 02 05:33:02.244980 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 530/1061] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:02 2022] GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d => generated 1136 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:02.856763 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-19199e3f-c352-4c19-a399-62176fefc1a5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:02.857704 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-19199e3f-c352-4c19-a399-62176fefc1a5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:02.865452 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19199e3f-c352-4c19-a399-62176fefc1a5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:02.865937 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19199e3f-c352-4c19-a399-62176fefc1a5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:02.866367 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19199e3f-c352-4c19-a399-62176fefc1a5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:02.867052 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19199e3f-c352-4c19-a399-62176fefc1a5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:02.867502 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19199e3f-c352-4c19-a399-62176fefc1a5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:02.867925 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19199e3f-c352-4c19-a399-62176fefc1a5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:03.000242 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-19199e3f-c352-4c19-a399-62176fefc1a5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:03.008718 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-19199e3f-c352-4c19-a399-62176fefc1a5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:03.010219 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-19199e3f-c352-4c19-a399-62176fefc1a5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:03.011446 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-19199e3f-c352-4c19-a399-62176fefc1a5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1722 microversion: 2.20 time: 0.161394 Sep 02 05:33:03.012049 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 532/1062] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:02 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:03.041356 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-7da80e1e-ce93-42b0-b252-78d9baef9e0b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:03.043494 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-7da80e1e-ce93-42b0-b252-78d9baef9e0b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:03.049992 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7da80e1e-ce93-42b0-b252-78d9baef9e0b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:03.050522 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7da80e1e-ce93-42b0-b252-78d9baef9e0b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:03.050993 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7da80e1e-ce93-42b0-b252-78d9baef9e0b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:03.051718 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7da80e1e-ce93-42b0-b252-78d9baef9e0b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:03.052146 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7da80e1e-ce93-42b0-b252-78d9baef9e0b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:03.052593 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7da80e1e-ce93-42b0-b252-78d9baef9e0b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:03.084663 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-7da80e1e-ce93-42b0-b252-78d9baef9e0b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047680 Sep 02 05:33:03.085287 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 531/1063] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Sep 2 05:33:03 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:33:03.273009 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-5715b2d8-6b37-428e-b00a-bc15b17453b9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:03.273931 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-5715b2d8-6b37-428e-b00a-bc15b17453b9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: 7b97865b-0582-4cf4-a4a7-d7aaa655251d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:03.282831 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5715b2d8-6b37-428e-b00a-bc15b17453b9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:03.283308 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5715b2d8-6b37-428e-b00a-bc15b17453b9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:03.283763 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5715b2d8-6b37-428e-b00a-bc15b17453b9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:03.284847 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5715b2d8-6b37-428e-b00a-bc15b17453b9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:03.285298 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5715b2d8-6b37-428e-b00a-bc15b17453b9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:03.285720 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5715b2d8-6b37-428e-b00a-bc15b17453b9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:03.520599 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-5715b2d8-6b37-428e-b00a-bc15b17453b9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:03.528565 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-5715b2d8-6b37-428e-b00a-bc15b17453b9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d" status: 200 len: 1192 microversion: 2.1 time: 0.262048 Sep 02 05:33:03.529039 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 533/1064] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:03 2022] GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d => generated 1192 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:04.035498 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-accf6a83-ba2e-4e95-a262-d7bba2c5c20c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:04.036243 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-accf6a83-ba2e-4e95-a262-d7bba2c5c20c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:04.042724 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-accf6a83-ba2e-4e95-a262-d7bba2c5c20c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:04.043207 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-accf6a83-ba2e-4e95-a262-d7bba2c5c20c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:04.043626 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-accf6a83-ba2e-4e95-a262-d7bba2c5c20c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:04.044429 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-accf6a83-ba2e-4e95-a262-d7bba2c5c20c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:04.044925 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-accf6a83-ba2e-4e95-a262-d7bba2c5c20c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:04.045348 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-accf6a83-ba2e-4e95-a262-d7bba2c5c20c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:04.097560 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-71711bb8-f2f6-4447-b58b-b63e537b86f5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:04.099935 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-71711bb8-f2f6-4447-b58b-b63e537b86f5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:04.107153 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-71711bb8-f2f6-4447-b58b-b63e537b86f5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:04.107646 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-71711bb8-f2f6-4447-b58b-b63e537b86f5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:04.108081 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-71711bb8-f2f6-4447-b58b-b63e537b86f5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:04.112326 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-71711bb8-f2f6-4447-b58b-b63e537b86f5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:04.112802 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-71711bb8-f2f6-4447-b58b-b63e537b86f5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:04.113257 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-71711bb8-f2f6-4447-b58b-b63e537b86f5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:04.154152 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-71711bb8-f2f6-4447-b58b-b63e537b86f5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060833 Sep 02 05:33:04.154980 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 534/1065] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Sep 2 05:33:04 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 05:33:04.253395 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-accf6a83-ba2e-4e95-a262-d7bba2c5c20c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:04.265020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-accf6a83-ba2e-4e95-a262-d7bba2c5c20c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:04.266884 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-accf6a83-ba2e-4e95-a262-d7bba2c5c20c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:04.268772 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-accf6a83-ba2e-4e95-a262-d7bba2c5c20c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1722 microversion: 2.20 time: 0.237219 Sep 02 05:33:04.269369 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 532/1066] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:04 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:04.551379 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-b5774379-728a-4638-8be0-6eaac8e212df tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:04.552381 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-b5774379-728a-4638-8be0-6eaac8e212df tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: 7b97865b-0582-4cf4-a4a7-d7aaa655251d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:04.559135 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b5774379-728a-4638-8be0-6eaac8e212df tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:04.559620 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b5774379-728a-4638-8be0-6eaac8e212df tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:04.560048 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b5774379-728a-4638-8be0-6eaac8e212df tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:04.560762 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b5774379-728a-4638-8be0-6eaac8e212df tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:04.561296 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b5774379-728a-4638-8be0-6eaac8e212df tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:04.561754 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b5774379-728a-4638-8be0-6eaac8e212df tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:04.705924 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-b5774379-728a-4638-8be0-6eaac8e212df tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:04.714009 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-b5774379-728a-4638-8be0-6eaac8e212df tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d" status: 200 len: 1277 microversion: 2.1 time: 0.167566 Sep 02 05:33:04.714925 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 535/1067] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:04 2022] GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:05.169424 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-62df97bc-6c58-4d21-943a-ef93d426480e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:05.171911 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-62df97bc-6c58-4d21-943a-ef93d426480e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:05.176110 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:33:05.180088 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-62df97bc-6c58-4d21-943a-ef93d426480e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:05.180620 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-62df97bc-6c58-4d21-943a-ef93d426480e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:05.181091 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-62df97bc-6c58-4d21-943a-ef93d426480e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:05.181754 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-62df97bc-6c58-4d21-943a-ef93d426480e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:05.182236 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-62df97bc-6c58-4d21-943a-ef93d426480e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:05.182649 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-62df97bc-6c58-4d21-943a-ef93d426480e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:05.215754 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-62df97bc-6c58-4d21-943a-ef93d426480e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053190 Sep 02 05:33:05.216408 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 533/1068] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Sep 2 05:33:05 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 05:33:05.278156 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-f69855a9-c381-4661-9b83-a414c4596975 req-15ec46a8-0106-4905-9147-4cdd40f226f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b97865b-0582-4cf4-a4a7-d7aaa655251d", "tag": "5143e5e1-5d0c-40d4-854f-4a447b64972c"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:33:05.286672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:33:05.293878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-f69855a9-c381-4661-9b83-a414c4596975 req-15ec46a8-0106-4905-9147-4cdd40f226f3 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:05.294528 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-f69855a9-c381-4661-9b83-a414c4596975 req-15ec46a8-0106-4905-9147-4cdd40f226f3 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:05.295121 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-f69855a9-c381-4661-9b83-a414c4596975 req-15ec46a8-0106-4905-9147-4cdd40f226f3 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:05.300248 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-79f7ab89-0491-4a8c-809a-36d5095bdba8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:05.300748 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-79f7ab89-0491-4a8c-809a-36d5095bdba8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:05.306734 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-79f7ab89-0491-4a8c-809a-36d5095bdba8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:05.307396 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-79f7ab89-0491-4a8c-809a-36d5095bdba8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:05.308404 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-79f7ab89-0491-4a8c-809a-36d5095bdba8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:05.309268 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-79f7ab89-0491-4a8c-809a-36d5095bdba8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:05.310240 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-79f7ab89-0491-4a8c-809a-36d5095bdba8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:05.310850 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-79f7ab89-0491-4a8c-809a-36d5095bdba8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:05.311420 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-f69855a9-c381-4661-9b83-a414c4596975 req-15ec46a8-0106-4905-9147-4cdd40f226f3 service nova] Creating event network-changed:5143e5e1-5d0c-40d4-854f-4a447b64972c for instance 7b97865b-0582-4cf4-a4a7-d7aaa655251d on hv-cinder-85391 Sep 02 05:33:05.319059 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-f69855a9-c381-4661-9b83-a414c4596975 req-15ec46a8-0106-4905-9147-4cdd40f226f3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048630 Sep 02 05:33:05.319963 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 536/1069] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:33:05.325482 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-27e6efca-2e7e-43f2-8c87-0b3acb3bfa92 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:05.326174 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-27e6efca-2e7e-43f2-8c87-0b3acb3bfa92 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:05.333887 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-27e6efca-2e7e-43f2-8c87-0b3acb3bfa92 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:05.334698 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-27e6efca-2e7e-43f2-8c87-0b3acb3bfa92 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:05.335333 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-27e6efca-2e7e-43f2-8c87-0b3acb3bfa92 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:05.336808 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-27e6efca-2e7e-43f2-8c87-0b3acb3bfa92 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:05.337258 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-27e6efca-2e7e-43f2-8c87-0b3acb3bfa92 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:05.337684 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-27e6efca-2e7e-43f2-8c87-0b3acb3bfa92 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:05.348881 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-79f7ab89-0491-4a8c-809a-36d5095bdba8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Going to try to terminate instance {{(pid=120449) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 05:33:05.451641 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-79f7ab89-0491-4a8c-809a-36d5095bdba8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0" status: 204 len: 0 microversion: 2.1 time: 0.162396 Sep 02 05:33:05.455576 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 534/1070] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Sep 2 05:33:05 2022] DELETE /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 02 05:33:05.465604 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-8c2dbd3f-7828-4ade-8de8-d4cb8d51357a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:05.466467 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-8c2dbd3f-7828-4ade-8de8-d4cb8d51357a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:05.473472 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8c2dbd3f-7828-4ade-8de8-d4cb8d51357a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:05.473960 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8c2dbd3f-7828-4ade-8de8-d4cb8d51357a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:05.474394 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8c2dbd3f-7828-4ade-8de8-d4cb8d51357a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:05.475091 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8c2dbd3f-7828-4ade-8de8-d4cb8d51357a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:05.475543 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8c2dbd3f-7828-4ade-8de8-d4cb8d51357a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:05.479816 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8c2dbd3f-7828-4ade-8de8-d4cb8d51357a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:05.511762 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-27e6efca-2e7e-43f2-8c87-0b3acb3bfa92 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:05.520567 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-27e6efca-2e7e-43f2-8c87-0b3acb3bfa92 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:05.522007 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-27e6efca-2e7e-43f2-8c87-0b3acb3bfa92 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:05.523209 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-27e6efca-2e7e-43f2-8c87-0b3acb3bfa92 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1722 microversion: 2.20 time: 0.202152 Sep 02 05:33:05.523766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 537/1071] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:05 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:05.608717 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-8c2dbd3f-7828-4ade-8de8-d4cb8d51357a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:05.620634 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-8c2dbd3f-7828-4ade-8de8-d4cb8d51357a tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0" status: 200 len: 1680 microversion: 2.1 time: 0.162584 Sep 02 05:33:05.621394 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 535/1072] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:05 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:05.737641 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-027ac275-d2f2-412d-827d-4d012c7f47f0 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:05.738273 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-027ac275-d2f2-412d-827d-4d012c7f47f0 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: 7b97865b-0582-4cf4-a4a7-d7aaa655251d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:05.744680 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-027ac275-d2f2-412d-827d-4d012c7f47f0 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:05.745157 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-027ac275-d2f2-412d-827d-4d012c7f47f0 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:05.745586 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-027ac275-d2f2-412d-827d-4d012c7f47f0 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:05.746297 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-027ac275-d2f2-412d-827d-4d012c7f47f0 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:05.746771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-027ac275-d2f2-412d-827d-4d012c7f47f0 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:05.747135 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-027ac275-d2f2-412d-827d-4d012c7f47f0 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:05.890515 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-027ac275-d2f2-412d-827d-4d012c7f47f0 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:05.899483 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-027ac275-d2f2-412d-827d-4d012c7f47f0 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d" status: 200 len: 1265 microversion: 2.1 time: 0.166123 Sep 02 05:33:05.900071 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 538/1073] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:05 2022] GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:06.546465 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-12afa4b6-c81d-46ac-b83d-cc472a7f282e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:06.547081 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-12afa4b6-c81d-46ac-b83d-cc472a7f282e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:06.554119 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-12afa4b6-c81d-46ac-b83d-cc472a7f282e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:06.554670 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-12afa4b6-c81d-46ac-b83d-cc472a7f282e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:06.555121 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-12afa4b6-c81d-46ac-b83d-cc472a7f282e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:06.555958 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-12afa4b6-c81d-46ac-b83d-cc472a7f282e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:06.556547 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-12afa4b6-c81d-46ac-b83d-cc472a7f282e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:06.557021 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-12afa4b6-c81d-46ac-b83d-cc472a7f282e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:06.645716 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-66711f18-ee2c-4f6e-9312-fb7c51dc255e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:06.646464 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-66711f18-ee2c-4f6e-9312-fb7c51dc255e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:06.653199 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-66711f18-ee2c-4f6e-9312-fb7c51dc255e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:06.653682 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-66711f18-ee2c-4f6e-9312-fb7c51dc255e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:06.654128 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-66711f18-ee2c-4f6e-9312-fb7c51dc255e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:06.654951 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-66711f18-ee2c-4f6e-9312-fb7c51dc255e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:06.655420 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-66711f18-ee2c-4f6e-9312-fb7c51dc255e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:06.655934 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-66711f18-ee2c-4f6e-9312-fb7c51dc255e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:06.675143 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=100 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:33:06.694554 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-12afa4b6-c81d-46ac-b83d-cc472a7f282e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:06.703298 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-12afa4b6-c81d-46ac-b83d-cc472a7f282e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:06.705127 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-12afa4b6-c81d-46ac-b83d-cc472a7f282e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:06.706326 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-12afa4b6-c81d-46ac-b83d-cc472a7f282e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1722 microversion: 2.20 time: 0.163895 Sep 02 05:33:06.707357 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 536/1074] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:06 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:06.794205 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-66711f18-ee2c-4f6e-9312-fb7c51dc255e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:06.803190 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-66711f18-ee2c-4f6e-9312-fb7c51dc255e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0" status: 200 len: 1680 microversion: 2.1 time: 0.162444 Sep 02 05:33:06.804010 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 539/1075] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:06 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:06.920629 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-81066425-01aa-4aaa-b84a-5db5ede03907 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:06.921277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-81066425-01aa-4aaa-b84a-5db5ede03907 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: 7b97865b-0582-4cf4-a4a7-d7aaa655251d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:06.928476 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-81066425-01aa-4aaa-b84a-5db5ede03907 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:06.928959 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-81066425-01aa-4aaa-b84a-5db5ede03907 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:06.929389 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-81066425-01aa-4aaa-b84a-5db5ede03907 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:06.930071 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-81066425-01aa-4aaa-b84a-5db5ede03907 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:06.930516 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-81066425-01aa-4aaa-b84a-5db5ede03907 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:06.930934 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-81066425-01aa-4aaa-b84a-5db5ede03907 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:07.066791 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-81066425-01aa-4aaa-b84a-5db5ede03907 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:07.074857 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-81066425-01aa-4aaa-b84a-5db5ede03907 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d" status: 200 len: 1265 microversion: 2.1 time: 0.158209 Sep 02 05:33:07.075471 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 537/1076] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:06 2022] GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:07.729988 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-8b53ac42-4dac-419d-9895-24e91d143aa6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:07.730592 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-8b53ac42-4dac-419d-9895-24e91d143aa6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:07.737858 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8b53ac42-4dac-419d-9895-24e91d143aa6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:07.738343 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8b53ac42-4dac-419d-9895-24e91d143aa6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:07.738806 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8b53ac42-4dac-419d-9895-24e91d143aa6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:07.739464 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8b53ac42-4dac-419d-9895-24e91d143aa6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:07.739918 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8b53ac42-4dac-419d-9895-24e91d143aa6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:07.740379 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8b53ac42-4dac-419d-9895-24e91d143aa6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:07.824717 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-44691ae8-fa62-47ab-b260-6e4ffe61eb3f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:07.825341 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-44691ae8-fa62-47ab-b260-6e4ffe61eb3f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:07.833723 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-44691ae8-fa62-47ab-b260-6e4ffe61eb3f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:07.834217 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-44691ae8-fa62-47ab-b260-6e4ffe61eb3f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:07.834649 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-44691ae8-fa62-47ab-b260-6e4ffe61eb3f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:07.835424 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-44691ae8-fa62-47ab-b260-6e4ffe61eb3f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:07.836015 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-44691ae8-fa62-47ab-b260-6e4ffe61eb3f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:07.836808 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-44691ae8-fa62-47ab-b260-6e4ffe61eb3f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:07.841851 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:33:07.887755 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-8b53ac42-4dac-419d-9895-24e91d143aa6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:07.896287 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-8b53ac42-4dac-419d-9895-24e91d143aa6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:07.897745 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-8b53ac42-4dac-419d-9895-24e91d143aa6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:07.898951 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-8b53ac42-4dac-419d-9895-24e91d143aa6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1722 microversion: 2.20 time: 0.172954 Sep 02 05:33:07.899520 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 540/1077] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:07 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:07.994138 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-44691ae8-fa62-47ab-b260-6e4ffe61eb3f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:08.002796 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-44691ae8-fa62-47ab-b260-6e4ffe61eb3f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0" status: 200 len: 1680 microversion: 2.1 time: 0.181989 Sep 02 05:33:08.003370 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 538/1078] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:07 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0 => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:33:08.096082 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-5c8d4f47-7243-45d6-a243-b846e19a8d3d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:08.096644 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-5c8d4f47-7243-45d6-a243-b846e19a8d3d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: 7b97865b-0582-4cf4-a4a7-d7aaa655251d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:08.102907 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5c8d4f47-7243-45d6-a243-b846e19a8d3d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:08.103397 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5c8d4f47-7243-45d6-a243-b846e19a8d3d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:08.103817 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5c8d4f47-7243-45d6-a243-b846e19a8d3d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:08.104553 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5c8d4f47-7243-45d6-a243-b846e19a8d3d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:08.105010 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5c8d4f47-7243-45d6-a243-b846e19a8d3d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:08.105447 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5c8d4f47-7243-45d6-a243-b846e19a8d3d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:08.253034 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-5c8d4f47-7243-45d6-a243-b846e19a8d3d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:08.265719 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-5c8d4f47-7243-45d6-a243-b846e19a8d3d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d" status: 200 len: 1265 microversion: 2.1 time: 0.173426 Sep 02 05:33:08.266345 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 541/1079] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:08 2022] GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:08.924417 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-279e7c04-40bc-4c70-869e-c96ae54216ef tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:08.925029 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-279e7c04-40bc-4c70-869e-c96ae54216ef tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:08.932142 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-279e7c04-40bc-4c70-869e-c96ae54216ef tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:08.932646 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-279e7c04-40bc-4c70-869e-c96ae54216ef tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:08.933174 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-279e7c04-40bc-4c70-869e-c96ae54216ef tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:08.933911 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-279e7c04-40bc-4c70-869e-c96ae54216ef tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:08.934361 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-279e7c04-40bc-4c70-869e-c96ae54216ef tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:08.934784 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-279e7c04-40bc-4c70-869e-c96ae54216ef tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:09.025809 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-65d805bf-1f1a-4db5-9251-eb74215c3e19 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:09.026638 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-65d805bf-1f1a-4db5-9251-eb74215c3e19 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:09.029783 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell0:SELECT=2 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:33:09.031385 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell0:SELECT=8 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:33:09.036411 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-65d805bf-1f1a-4db5-9251-eb74215c3e19 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:09.037239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-65d805bf-1f1a-4db5-9251-eb74215c3e19 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:09.037728 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-65d805bf-1f1a-4db5-9251-eb74215c3e19 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:09.038527 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-65d805bf-1f1a-4db5-9251-eb74215c3e19 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:09.039189 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-65d805bf-1f1a-4db5-9251-eb74215c3e19 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:09.039828 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-65d805bf-1f1a-4db5-9251-eb74215c3e19 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:09.419925 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-279e7c04-40bc-4c70-869e-c96ae54216ef tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:09.427634 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-65d805bf-1f1a-4db5-9251-eb74215c3e19 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:09.428554 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-279e7c04-40bc-4c70-869e-c96ae54216ef tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:09.430102 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-279e7c04-40bc-4c70-869e-c96ae54216ef tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:09.431250 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-279e7c04-40bc-4c70-869e-c96ae54216ef tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1722 microversion: 2.20 time: 0.511634 Sep 02 05:33:09.431748 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 539/1080] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:08 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1722 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:09.436340 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-0fe91a76-8beb-41b2-946b-cfb7800231de tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:09.436941 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-0fe91a76-8beb-41b2-946b-cfb7800231de tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: 7b97865b-0582-4cf4-a4a7-d7aaa655251d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:09.444611 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-65d805bf-1f1a-4db5-9251-eb74215c3e19 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0" status: 200 len: 1680 microversion: 2.1 time: 0.423854 Sep 02 05:33:09.446928 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 542/1081] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:09 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0 => generated 1680 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:09.448701 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0fe91a76-8beb-41b2-946b-cfb7800231de tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:09.449260 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0fe91a76-8beb-41b2-946b-cfb7800231de tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:09.449761 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0fe91a76-8beb-41b2-946b-cfb7800231de tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:09.450557 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0fe91a76-8beb-41b2-946b-cfb7800231de tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:09.451086 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0fe91a76-8beb-41b2-946b-cfb7800231de tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:09.451562 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0fe91a76-8beb-41b2-946b-cfb7800231de tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:09.678532 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-0fe91a76-8beb-41b2-946b-cfb7800231de tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:09.686683 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-0fe91a76-8beb-41b2-946b-cfb7800231de tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d" status: 200 len: 1265 microversion: 2.1 time: 0.253873 Sep 02 05:33:09.687426 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 540/1082] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:09 2022] GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:10.131698 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-58695fd4-5bd4-4da0-9ab7-7f8825408ca2 req-9e1b3c9d-915f-46d6-b159-7c5cf8ccd2dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d783711-2893-40ce-8b8b-800090dd1ef0", "name": "network-vif-deleted", "tag": "a9f72ebb-4815-42c7-8ffd-a581daf00288"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:33:10.143903 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-58695fd4-5bd4-4da0-9ab7-7f8825408ca2 req-9e1b3c9d-915f-46d6-b159-7c5cf8ccd2dc service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:10.144699 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-58695fd4-5bd4-4da0-9ab7-7f8825408ca2 req-9e1b3c9d-915f-46d6-b159-7c5cf8ccd2dc service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:10.145311 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-58695fd4-5bd4-4da0-9ab7-7f8825408ca2 req-9e1b3c9d-915f-46d6-b159-7c5cf8ccd2dc service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:10.157590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-58695fd4-5bd4-4da0-9ab7-7f8825408ca2 req-9e1b3c9d-915f-46d6-b159-7c5cf8ccd2dc service nova] Creating event network-vif-deleted:a9f72ebb-4815-42c7-8ffd-a581daf00288 for instance 1d783711-2893-40ce-8b8b-800090dd1ef0 on hv-cinder-85391 Sep 02 05:33:10.163870 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-58695fd4-5bd4-4da0-9ab7-7f8825408ca2 req-9e1b3c9d-915f-46d6-b159-7c5cf8ccd2dc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037428 Sep 02 05:33:10.164869 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 543/1083] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:33:10.453703 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-e5ab8972-7933-4630-ac67-bd50691517bc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:10.454929 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-e5ab8972-7933-4630-ac67-bd50691517bc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:10.468732 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-376709e9-a6cd-4a73-96b9-e0b4922a52b1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:10.478480 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-376709e9-a6cd-4a73-96b9-e0b4922a52b1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:10.490274 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e5ab8972-7933-4630-ac67-bd50691517bc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:10.500020 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-376709e9-a6cd-4a73-96b9-e0b4922a52b1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:10.501389 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e5ab8972-7933-4630-ac67-bd50691517bc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:10.502082 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e5ab8972-7933-4630-ac67-bd50691517bc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:10.502843 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e5ab8972-7933-4630-ac67-bd50691517bc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:10.503684 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-376709e9-a6cd-4a73-96b9-e0b4922a52b1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:10.504685 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-376709e9-a6cd-4a73-96b9-e0b4922a52b1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:10.506069 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e5ab8972-7933-4630-ac67-bd50691517bc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:10.506533 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e5ab8972-7933-4630-ac67-bd50691517bc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:10.507388 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-376709e9-a6cd-4a73-96b9-e0b4922a52b1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:10.507916 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-376709e9-a6cd-4a73-96b9-e0b4922a52b1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:10.508376 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-376709e9-a6cd-4a73-96b9-e0b4922a52b1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:10.555995 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-376709e9-a6cd-4a73-96b9-e0b4922a52b1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:10.556525 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-376709e9-a6cd-4a73-96b9-e0b4922a52b1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:10.556962 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-376709e9-a6cd-4a73-96b9-e0b4922a52b1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:10.557416 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.objects.instance [None req-376709e9-a6cd-4a73-96b9-e0b4922a52b1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lazy-loading 'fault' on Instance uuid 1d783711-2893-40ce-8b8b-800090dd1ef0 {{(pid=120448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:33:10.643145 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-376709e9-a6cd-4a73-96b9-e0b4922a52b1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:10.653623 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-376709e9-a6cd-4a73-96b9-e0b4922a52b1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0" status: 200 len: 1331 microversion: 2.1 time: 0.189760 Sep 02 05:33:10.668291 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 544/1084] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:10 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0 => generated 1331 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:10.716043 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-fdf3c0e0-a1e5-4e51-a154-050397adf31c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:10.721931 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-fdf3c0e0-a1e5-4e51-a154-050397adf31c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: 7b97865b-0582-4cf4-a4a7-d7aaa655251d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:10.729196 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fdf3c0e0-a1e5-4e51-a154-050397adf31c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:10.729875 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fdf3c0e0-a1e5-4e51-a154-050397adf31c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:10.730704 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fdf3c0e0-a1e5-4e51-a154-050397adf31c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:10.732099 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fdf3c0e0-a1e5-4e51-a154-050397adf31c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:10.732736 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fdf3c0e0-a1e5-4e51-a154-050397adf31c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:10.733384 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fdf3c0e0-a1e5-4e51-a154-050397adf31c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:10.735158 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e5ab8972-7933-4630-ac67-bd50691517bc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:10.745027 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e5ab8972-7933-4630-ac67-bd50691517bc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:10.747481 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e5ab8972-7933-4630-ac67-bd50691517bc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:10.748794 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-e5ab8972-7933-4630-ac67-bd50691517bc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1722 microversion: 2.20 time: 0.299142 Sep 02 05:33:10.764142 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 541/1085] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:10 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1722 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:10.919147 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-fdf3c0e0-a1e5-4e51-a154-050397adf31c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:10.930816 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-fdf3c0e0-a1e5-4e51-a154-050397adf31c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d" status: 200 len: 1265 microversion: 2.1 time: 0.227121 Sep 02 05:33:10.938153 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 545/1086] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:10 2022] GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:11.675185 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-84274da9-f41c-4044-86b2-948db0f849fc tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:11.675791 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-84274da9-f41c-4044-86b2-948db0f849fc tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:11.683323 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-84274da9-f41c-4044-86b2-948db0f849fc tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:11.683830 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-84274da9-f41c-4044-86b2-948db0f849fc tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:11.684318 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-84274da9-f41c-4044-86b2-948db0f849fc tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:11.685174 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-84274da9-f41c-4044-86b2-948db0f849fc tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:11.685719 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-84274da9-f41c-4044-86b2-948db0f849fc tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:11.686140 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-84274da9-f41c-4044-86b2-948db0f849fc tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:11.701516 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.wsgi [None req-84274da9-f41c-4044-86b2-948db0f849fc tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] HTTP exception thrown: Instance 1d783711-2893-40ce-8b8b-800090dd1ef0 could not be found. Sep 02 05:33:11.703491 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-84274da9-f41c-4044-86b2-948db0f849fc tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Request method failure captured: Sep 02 05:33:11.703491 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: request: GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0 HTTP/1.1 Sep 02 05:33:11.703491 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept: application/json Sep 02 05:33:11.703491 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept-Encoding: identity Sep 02 05:33:11.703491 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Connection: close Sep 02 05:33:11.703491 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Length: 0 Sep 02 05:33:11.703491 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Type: application/json Sep 02 05:33:11.703491 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Host: 10.222.0.30 Sep 02 05:33:11.703491 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Openstack-System-Scope: None Sep 02 05:33:11.703491 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: User-Agent: python-urllib3/1.26.12 Sep 02 05:33:11.703491 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Auth-Token: gAAAAABjEZM9sMpwUr9qoyGfMjDaBJ8P6YvBPQ-f9EMy1v-mwCEwm2r_bgyQO13MJw9PzuA9JX3XTWqubrdQgU1a6BCBynzOqQh_kSQW7GnBay9PYEuOinJQJVybarMVc5DymGEpqCE1wXufVXEiHhxifOsWWijBJ0RmMiTE9rG9XyLkwahJIcQ Sep 02 05:33:11.703491 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Id: None Sep 02 05:33:11.703491 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Name: None Sep 02 05:33:11.703491 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Identity-Status: Confirmed Sep 02 05:33:11.703491 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Is-Admin-Project: True Sep 02 05:33:11.703491 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Id: default Sep 02 05:33:11.703491 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Name: Default Sep 02 05:33:11.703491 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Id: 0847ca942df54b659e8723463ab72c65 Sep 02 05:33:11.703491 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Name: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:33:11.703491 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Role: member,reader Sep 02 05:33:11.703491 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Roles: member,reader Sep 02 05:33:11.704855 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0847ca942df54b659e8723463ab72c65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0847ca942df54b659e8723463ab72c65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0847ca942df54b659e8723463ab72c65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0847ca942df54b659e8723463ab72c65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:33:11.704855 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:33:11.704855 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Id: 0847ca942df54b659e8723463ab72c65 Sep 02 05:33:11.704855 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:33:11.704855 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User: tempest-AttachVolumeNegativeTest-1685577678-project Sep 02 05:33:11.704855 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Id: default Sep 02 05:33:11.704855 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Name: Default Sep 02 05:33:11.704855 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Id: ee1a3027b52f4b46bc5cff18f9cd0b02 Sep 02 05:33:11.704855 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Name: tempest-AttachVolumeNegativeTest-1685577678-project Sep 02 05:33:11.704855 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: method: > Sep 02 05:33:11.704855 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: exception: Instance 1d783711-2893-40ce-8b8b-800090dd1ef0 could not be found. Sep 02 05:33:11.704855 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: action_args: {'id': '1d783711-2893-40ce-8b8b-800090dd1ef0'} Sep 02 05:33:11.705806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:33:11.705806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:33:11.705806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:33:11.705806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:33:11.705806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:33:11.705806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:33:11.705806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:33:11.705806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:33:11.705806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:33:11.705806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:33:11.705806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d783711-2893-40ce-8b8b-800090dd1ef0 could not be found. Sep 02 05:33:11.705806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:33:11.705806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:33:11.705806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:33:11.705806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:33:11.705806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:33:11.705806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:33:11.705806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:33:11.705806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:33:11.705806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:33:11.707051 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:33:11.707051 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:33:11.707051 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:33:11.707051 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:33:11.707051 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:33:11.707051 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:33:11.707051 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:33:11.707051 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d783711-2893-40ce-8b8b-800090dd1ef0 could not be found. Sep 02 05:33:11.707051 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:33:11.707051 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:33:11.707051 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:33:11.707051 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:33:11.707051 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:33:11.707051 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:33:11.707051 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:33:11.707051 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:33:11.707051 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d783711-2893-40ce-8b8b-800090dd1ef0 could not be found. Sep 02 05:33:11.707051 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:33:11.708198 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-84274da9-f41c-4044-86b2-948db0f849fc tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Returning 404 to user: Instance 1d783711-2893-40ce-8b8b-800090dd1ef0 could not be found. {{(pid=120449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:33:11.708198 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-84274da9-f41c-4044-86b2-948db0f849fc tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0" status: 404 len: 111 microversion: 2.1 time: 0.033526 Sep 02 05:33:11.708198 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 542/1087] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:11 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:33:11.716689 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-a0efca8d-6b31-4182-8601-d5dc342bebf1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '.version_select at 0x7fc90b318f70>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:11.745704 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-a0efca8d-6b31-4182-8601-d5dc342bebf1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-368429421" status: 202 len: 0 microversion: 2.1 time: 0.034553 Sep 02 05:33:11.746290 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 546/1088] 10.222.0.30 () {58 vars in 1218 bytes} [Fri Sep 2 05:33:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-368429421 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:33:11.775340 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-9a0da151-3e8a-4cd2-a445-550c756f314d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:11.776097 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-9a0da151-3e8a-4cd2-a445-550c756f314d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:11.785793 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9a0da151-3e8a-4cd2-a445-550c756f314d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:11.786307 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9a0da151-3e8a-4cd2-a445-550c756f314d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:11.786746 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9a0da151-3e8a-4cd2-a445-550c756f314d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:11.787586 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9a0da151-3e8a-4cd2-a445-550c756f314d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:11.788032 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9a0da151-3e8a-4cd2-a445-550c756f314d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:11.788616 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9a0da151-3e8a-4cd2-a445-550c756f314d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:11.956286 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-425679a9-3f23-4364-95d0-a028095868f7 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:11.957327 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-425679a9-3f23-4364-95d0-a028095868f7 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: 7b97865b-0582-4cf4-a4a7-d7aaa655251d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:11.963570 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-425679a9-3f23-4364-95d0-a028095868f7 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:11.964326 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-425679a9-3f23-4364-95d0-a028095868f7 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:11.965000 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-425679a9-3f23-4364-95d0-a028095868f7 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:11.965754 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-425679a9-3f23-4364-95d0-a028095868f7 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:11.966215 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-425679a9-3f23-4364-95d0-a028095868f7 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:11.966663 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-425679a9-3f23-4364-95d0-a028095868f7 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:11.971937 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-9a0da151-3e8a-4cd2-a445-550c756f314d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:11.987669 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-9a0da151-3e8a-4cd2-a445-550c756f314d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:11.989338 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-9a0da151-3e8a-4cd2-a445-550c756f314d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:11.990719 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-9a0da151-3e8a-4cd2-a445-550c756f314d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1722 microversion: 2.20 time: 0.221201 Sep 02 05:33:12.005111 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 543/1089] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:11 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:12.103968 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-425679a9-3f23-4364-95d0-a028095868f7 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:12.112425 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-425679a9-3f23-4364-95d0-a028095868f7 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d" status: 200 len: 1265 microversion: 2.1 time: 0.161688 Sep 02 05:33:12.112998 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 547/1090] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:11 2022] GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:33:12.774667 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-b582678e-82ef-41dd-a759-e599a5a65ff8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Action: 'create', calling method: .version_select at 0x7fc90b21cc10>, body: {"keypair": {"name": "tempest-keypair-1769682523", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIJKlrEgawdhSHV6gLna+rgII/C2uzw3xKwhWiecs/J6qkjDmrlCE96qQkEdQJgg92WAUyU85zlupZtQKqA3uLwSFNGUcPGBs+RYkayakwJYJ4oTlNyvKXZmADKLxK6Kg=="}} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:33:12.791874 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.quota [None req-b582678e-82ef-41dd-a759-e599a5a65ff8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Getting quotas for project 0847ca942df54b659e8723463ab72c65. Resources: {'key_pairs'} {{(pid=120449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:33:12.795964 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.quota [None req-b582678e-82ef-41dd-a759-e599a5a65ff8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Getting quotas for user ee1a3027b52f4b46bc5cff18f9cd0b02 and project 0847ca942df54b659e8723463ab72c65. Resources: {'key_pairs'} {{(pid=120449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:33:12.819475 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-b582678e-82ef-41dd-a759-e599a5a65ff8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048821 Sep 02 05:33:12.820435 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 544/1091] 10.222.0.30 () {60 vars in 1159 bytes} [Fri Sep 2 05:33:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:33:13.020906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-4c865ab5-2b57-4c6f-ad76-d9b813c0e90c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:13.022322 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-4c865ab5-2b57-4c6f-ad76-d9b813c0e90c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:13.030339 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4c865ab5-2b57-4c6f-ad76-d9b813c0e90c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:13.031177 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4c865ab5-2b57-4c6f-ad76-d9b813c0e90c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:13.031703 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4c865ab5-2b57-4c6f-ad76-d9b813c0e90c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:13.032686 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4c865ab5-2b57-4c6f-ad76-d9b813c0e90c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:13.033344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4c865ab5-2b57-4c6f-ad76-d9b813c0e90c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:13.033988 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4c865ab5-2b57-4c6f-ad76-d9b813c0e90c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:13.133569 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-540b1035-51d4-4ceb-a63b-acf08547e146 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:13.134474 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-540b1035-51d4-4ceb-a63b-acf08547e146 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: 7b97865b-0582-4cf4-a4a7-d7aaa655251d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:13.141042 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-540b1035-51d4-4ceb-a63b-acf08547e146 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:13.141708 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-540b1035-51d4-4ceb-a63b-acf08547e146 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:13.142332 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-540b1035-51d4-4ceb-a63b-acf08547e146 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:13.143297 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-540b1035-51d4-4ceb-a63b-acf08547e146 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:13.144598 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-540b1035-51d4-4ceb-a63b-acf08547e146 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:13.145340 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-540b1035-51d4-4ceb-a63b-acf08547e146 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:13.350435 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-4c865ab5-2b57-4c6f-ad76-d9b813c0e90c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:13.367308 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-4c865ab5-2b57-4c6f-ad76-d9b813c0e90c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:13.370748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-4c865ab5-2b57-4c6f-ad76-d9b813c0e90c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:13.372575 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-4c865ab5-2b57-4c6f-ad76-d9b813c0e90c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1722 microversion: 2.20 time: 0.356063 Sep 02 05:33:13.387530 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-540b1035-51d4-4ceb-a63b-acf08547e146 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:13.387530 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-540b1035-51d4-4ceb-a63b-acf08547e146 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d" status: 200 len: 1265 microversion: 2.1 time: 0.257008 Sep 02 05:33:13.387530 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 545/1092] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:13 2022] GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:13.390541 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 548/1093] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:13 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1722 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:13.781881 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-21bf0539-4c6c-4526-896c-122dd32de86e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:13.785751 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-21bf0539-4c6c-4526-896c-122dd32de86e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:13.799987 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-21bf0539-4c6c-4526-896c-122dd32de86e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:13.800512 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-21bf0539-4c6c-4526-896c-122dd32de86e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:13.800949 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-21bf0539-4c6c-4526-896c-122dd32de86e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:13.801654 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-21bf0539-4c6c-4526-896c-122dd32de86e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:13.802105 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-21bf0539-4c6c-4526-896c-122dd32de86e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:13.802527 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-21bf0539-4c6c-4526-896c-122dd32de86e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:13.847068 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-21bf0539-4c6c-4526-896c-122dd32de86e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070656 Sep 02 05:33:13.848709 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 546/1094] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Sep 2 05:33:13 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 02 05:33:13.937379 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f68a12a7-ea81-4eb9-a754-d93a7ad2d815 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:13.939164 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f68a12a7-ea81-4eb9-a754-d93a7ad2d815 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:13.948775 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f68a12a7-ea81-4eb9-a754-d93a7ad2d815 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:13.949935 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f68a12a7-ea81-4eb9-a754-d93a7ad2d815 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:13.950814 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f68a12a7-ea81-4eb9-a754-d93a7ad2d815 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:13.951681 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f68a12a7-ea81-4eb9-a754-d93a7ad2d815 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:13.952321 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f68a12a7-ea81-4eb9-a754-d93a7ad2d815 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:13.952965 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f68a12a7-ea81-4eb9-a754-d93a7ad2d815 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:13.995737 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f68a12a7-ea81-4eb9-a754-d93a7ad2d815 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Going to try to terminate instance {{(pid=120448) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 05:33:14.103988 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f68a12a7-ea81-4eb9-a754-d93a7ad2d815 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "DELETE /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 204 len: 0 microversion: 2.1 time: 0.171492 Sep 02 05:33:14.107343 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 549/1095] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Sep 2 05:33:13 2022] DELETE /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 05:33:14.116894 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-135a737c-e3f7-4f0c-865a-05e2ce514f0b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:14.117923 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-135a737c-e3f7-4f0c-865a-05e2ce514f0b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:14.125359 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-135a737c-e3f7-4f0c-865a-05e2ce514f0b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:14.125858 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-135a737c-e3f7-4f0c-865a-05e2ce514f0b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:14.126750 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-135a737c-e3f7-4f0c-865a-05e2ce514f0b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:14.127473 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-135a737c-e3f7-4f0c-865a-05e2ce514f0b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:14.127961 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-135a737c-e3f7-4f0c-865a-05e2ce514f0b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:14.128614 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-135a737c-e3f7-4f0c-865a-05e2ce514f0b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:14.386769 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-135a737c-e3f7-4f0c-865a-05e2ce514f0b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:14.398223 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-19627a5b-f1dd-4607-9ad0-15afdaaf1450 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:14.399349 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-19627a5b-f1dd-4607-9ad0-15afdaaf1450 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:14.410359 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-135a737c-e3f7-4f0c-865a-05e2ce514f0b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1673 microversion: 2.1 time: 0.298019 Sep 02 05:33:14.413029 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19627a5b-f1dd-4607-9ad0-15afdaaf1450 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:14.413716 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 547/1096] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:14 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1673 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:33:14.415537 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19627a5b-f1dd-4607-9ad0-15afdaaf1450 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:14.416259 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19627a5b-f1dd-4607-9ad0-15afdaaf1450 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:14.417053 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19627a5b-f1dd-4607-9ad0-15afdaaf1450 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:14.417750 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19627a5b-f1dd-4607-9ad0-15afdaaf1450 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:14.418375 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19627a5b-f1dd-4607-9ad0-15afdaaf1450 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:14.427923 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-57dcc055-b320-4f4b-ba91-b2b9bad68b61 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:14.428879 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-57dcc055-b320-4f4b-ba91-b2b9bad68b61 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: 7b97865b-0582-4cf4-a4a7-d7aaa655251d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:14.445968 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-57dcc055-b320-4f4b-ba91-b2b9bad68b61 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:14.446569 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-57dcc055-b320-4f4b-ba91-b2b9bad68b61 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:14.447067 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-57dcc055-b320-4f4b-ba91-b2b9bad68b61 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:14.447845 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-57dcc055-b320-4f4b-ba91-b2b9bad68b61 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:14.448403 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-57dcc055-b320-4f4b-ba91-b2b9bad68b61 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:14.448887 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-57dcc055-b320-4f4b-ba91-b2b9bad68b61 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:14.805323 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-57dcc055-b320-4f4b-ba91-b2b9bad68b61 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:14.808556 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-19627a5b-f1dd-4607-9ad0-15afdaaf1450 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:14.819737 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-19627a5b-f1dd-4607-9ad0-15afdaaf1450 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:14.821240 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-19627a5b-f1dd-4607-9ad0-15afdaaf1450 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:14.822446 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-19627a5b-f1dd-4607-9ad0-15afdaaf1450 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1743 microversion: 2.20 time: 0.428545 Sep 02 05:33:14.836460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 550/1097] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:14 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1743 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:33:14.837213 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-57dcc055-b320-4f4b-ba91-b2b9bad68b61 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d" status: 200 len: 1265 microversion: 2.1 time: 0.410902 Sep 02 05:33:14.837213 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 548/1098] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:14 2022] GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d => generated 1265 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:15.005553 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-ea26b9d8-663d-472a-ba8f-22dc119e2ecd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-502579096", "imageRef": "f3669111-2e3f-4f39-878f-19d263505eaa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64176975-8c6d-4d21-8413-773e395248ec"}], "security_groups": [{"name": "tempest-securitygroup--194211919"}], "key_name": "tempest-keypair-1769682523", "user_data": "}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:33:15.136676 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.network.neutron [None req-ea26b9d8-663d-472a-ba8f-22dc119e2ecd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] validate_networks() for [('64176975-8c6d-4d21-8413-773e395248ec', None, None, None, None, None)] {{(pid=120448) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 05:33:15.444380 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-2575b9d4-4802-46db-b09d-984d208fca65 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:15.446244 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-2575b9d4-4802-46db-b09d-984d208fca65 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:15.456429 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2575b9d4-4802-46db-b09d-984d208fca65 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:15.457210 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2575b9d4-4802-46db-b09d-984d208fca65 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:15.457748 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2575b9d4-4802-46db-b09d-984d208fca65 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:15.458581 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2575b9d4-4802-46db-b09d-984d208fca65 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:15.459167 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2575b9d4-4802-46db-b09d-984d208fca65 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:15.459716 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2575b9d4-4802-46db-b09d-984d208fca65 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:15.685336 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-2575b9d4-4802-46db-b09d-984d208fca65 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:15.700278 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-2575b9d4-4802-46db-b09d-984d208fca65 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1673 microversion: 2.1 time: 0.266155 Sep 02 05:33:15.701277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 549/1099] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:15 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1673 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:15.713193 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-ea26b9d8-663d-472a-ba8f-22dc119e2ecd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Flavor limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 05:33:15.713843 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-ea26b9d8-663d-472a-ba8f-22dc119e2ecd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Image limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 05:33:15.714627 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-ea26b9d8-663d-472a-ba8f-22dc119e2ecd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Flavor pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 05:33:15.715208 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-ea26b9d8-663d-472a-ba8f-22dc119e2ecd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Image pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 05:33:15.715618 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-ea26b9d8-663d-472a-ba8f-22dc119e2ecd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 05:33:15.729546 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ea26b9d8-663d-472a-ba8f-22dc119e2ecd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:15.730522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ea26b9d8-663d-472a-ba8f-22dc119e2ecd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:15.730979 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ea26b9d8-663d-472a-ba8f-22dc119e2ecd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:15.732023 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ea26b9d8-663d-472a-ba8f-22dc119e2ecd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:15.732514 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ea26b9d8-663d-472a-ba8f-22dc119e2ecd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:15.733528 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ea26b9d8-663d-472a-ba8f-22dc119e2ecd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:15.759576 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-ea26b9d8-663d-472a-ba8f-22dc119e2ecd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Getting quotas for project 0847ca942df54b659e8723463ab72c65. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:33:15.765224 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-ea26b9d8-663d-472a-ba8f-22dc119e2ecd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Getting quotas for user ee1a3027b52f4b46bc5cff18f9cd0b02 and project 0847ca942df54b659e8723463ab72c65. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:33:15.781052 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-ea26b9d8-663d-472a-ba8f-22dc119e2ecd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Going to run 1 instances... {{(pid=120448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 05:33:15.784682 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-ea26b9d8-663d-472a-ba8f-22dc119e2ecd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 47d13255-9c47-4bba-a83c-1bba0adb6276] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3669111-2e3f-4f39-878f-19d263505eaa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 05:33:15.846209 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-9ebee02a-a488-4f51-8e8e-47b2d1d02021 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:15.846917 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-9ebee02a-a488-4f51-8e8e-47b2d1d02021 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:15.855259 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9ebee02a-a488-4f51-8e8e-47b2d1d02021 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:15.855759 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9ebee02a-a488-4f51-8e8e-47b2d1d02021 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:15.856207 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9ebee02a-a488-4f51-8e8e-47b2d1d02021 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:15.856920 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9ebee02a-a488-4f51-8e8e-47b2d1d02021 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:15.862337 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9ebee02a-a488-4f51-8e8e-47b2d1d02021 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:15.863056 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9ebee02a-a488-4f51-8e8e-47b2d1d02021 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:15.889758 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-ea26b9d8-663d-472a-ba8f-22dc119e2ecd tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.888898 Sep 02 05:33:15.893395 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 551/1100] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Sep 2 05:33:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 05:33:15.906458 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-34cb44e2-6b94-4249-a927-0c486443503f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:15.910225 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-34cb44e2-6b94-4249-a927-0c486443503f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: 7b97865b-0582-4cf4-a4a7-d7aaa655251d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:15.922891 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-34cb44e2-6b94-4249-a927-0c486443503f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:15.924572 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-34cb44e2-6b94-4249-a927-0c486443503f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:15.926477 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-34cb44e2-6b94-4249-a927-0c486443503f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:15.929123 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-34cb44e2-6b94-4249-a927-0c486443503f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:15.929812 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-34cb44e2-6b94-4249-a927-0c486443503f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:15.930576 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-34cb44e2-6b94-4249-a927-0c486443503f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:16.177629 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-9ebee02a-a488-4f51-8e8e-47b2d1d02021 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:16.182266 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-34cb44e2-6b94-4249-a927-0c486443503f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:16.193233 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-9ebee02a-a488-4f51-8e8e-47b2d1d02021 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:16.193471 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-34cb44e2-6b94-4249-a927-0c486443503f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d" status: 200 len: 1265 microversion: 2.1 time: 0.298524 Sep 02 05:33:16.193836 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 552/1101] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:15 2022] GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d => generated 1265 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:16.196817 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-9ebee02a-a488-4f51-8e8e-47b2d1d02021 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:16.199058 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-206d8fe3-9905-4e83-923b-f80e272d4a1c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:16.199915 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-206d8fe3-9905-4e83-923b-f80e272d4a1c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 47d13255-9c47-4bba-a83c-1bba0adb6276] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:16.200277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-9ebee02a-a488-4f51-8e8e-47b2d1d02021 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1743 microversion: 2.20 time: 0.355707 Sep 02 05:33:16.203401 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 550/1102] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:15 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1743 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:16.293278 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-206d8fe3-9905-4e83-923b-f80e272d4a1c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:16.307648 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-206d8fe3-9905-4e83-923b-f80e272d4a1c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276" status: 200 len: 1241 microversion: 2.1 time: 0.111827 Sep 02 05:33:16.308277 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 553/1103] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:16 2022] GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276 => generated 1241 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:16.731526 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-22688fd3-d8fb-496f-8139-9b72f51a92c3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:16.736056 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-22688fd3-d8fb-496f-8139-9b72f51a92c3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:16.763622 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-22688fd3-d8fb-496f-8139-9b72f51a92c3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:16.773819 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-22688fd3-d8fb-496f-8139-9b72f51a92c3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:16.774893 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-22688fd3-d8fb-496f-8139-9b72f51a92c3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:16.776473 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-22688fd3-d8fb-496f-8139-9b72f51a92c3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:16.777117 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-22688fd3-d8fb-496f-8139-9b72f51a92c3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:16.778231 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-22688fd3-d8fb-496f-8139-9b72f51a92c3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:16.959188 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-22688fd3-d8fb-496f-8139-9b72f51a92c3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:16.967588 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-22688fd3-d8fb-496f-8139-9b72f51a92c3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1673 microversion: 2.1 time: 0.243087 Sep 02 05:33:16.968425 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 551/1104] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:16 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1673 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:17.214286 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-4e36e864-9c5e-4b46-8b24-9987dd6e4358 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:17.215185 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-4e36e864-9c5e-4b46-8b24-9987dd6e4358 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: 7b97865b-0582-4cf4-a4a7-d7aaa655251d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:17.224239 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-dd1a33cc-e1ba-483c-ac73-a55b1454f008 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:17.225296 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-dd1a33cc-e1ba-483c-ac73-a55b1454f008 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:17.225479 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4e36e864-9c5e-4b46-8b24-9987dd6e4358 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:17.225980 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4e36e864-9c5e-4b46-8b24-9987dd6e4358 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:17.226677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4e36e864-9c5e-4b46-8b24-9987dd6e4358 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:17.227667 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4e36e864-9c5e-4b46-8b24-9987dd6e4358 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:17.228447 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4e36e864-9c5e-4b46-8b24-9987dd6e4358 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:17.229056 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4e36e864-9c5e-4b46-8b24-9987dd6e4358 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:17.232061 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dd1a33cc-e1ba-483c-ac73-a55b1454f008 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:17.232603 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dd1a33cc-e1ba-483c-ac73-a55b1454f008 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:17.233046 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dd1a33cc-e1ba-483c-ac73-a55b1454f008 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:17.233904 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dd1a33cc-e1ba-483c-ac73-a55b1454f008 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:17.234378 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dd1a33cc-e1ba-483c-ac73-a55b1454f008 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:17.234776 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dd1a33cc-e1ba-483c-ac73-a55b1454f008 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:17.453889 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-dd1a33cc-e1ba-483c-ac73-a55b1454f008 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:17.464455 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-dd1a33cc-e1ba-483c-ac73-a55b1454f008 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:17.466129 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-dd1a33cc-e1ba-483c-ac73-a55b1454f008 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:17.466658 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-4e36e864-9c5e-4b46-8b24-9987dd6e4358 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:17.470195 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-dd1a33cc-e1ba-483c-ac73-a55b1454f008 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1743 microversion: 2.20 time: 0.250179 Sep 02 05:33:17.471172 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 552/1105] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:17 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1743 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:17.476198 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-4e36e864-9c5e-4b46-8b24-9987dd6e4358 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d" status: 200 len: 1265 microversion: 2.1 time: 0.265995 Sep 02 05:33:17.488218 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-a19f0b31-3f7e-4b47-9fc0-376ccf6e3030 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:17.490044 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-a19f0b31-3f7e-4b47-9fc0-376ccf6e3030 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 47d13255-9c47-4bba-a83c-1bba0adb6276] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:17.490451 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 554/1106] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:17 2022] GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d => generated 1265 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:17.498202 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a19f0b31-3f7e-4b47-9fc0-376ccf6e3030 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:17.498702 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a19f0b31-3f7e-4b47-9fc0-376ccf6e3030 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:17.500070 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a19f0b31-3f7e-4b47-9fc0-376ccf6e3030 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:17.500871 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a19f0b31-3f7e-4b47-9fc0-376ccf6e3030 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:17.501323 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a19f0b31-3f7e-4b47-9fc0-376ccf6e3030 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:17.511703 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a19f0b31-3f7e-4b47-9fc0-376ccf6e3030 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:17.597077 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-a19f0b31-3f7e-4b47-9fc0-376ccf6e3030 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:17.609413 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-a19f0b31-3f7e-4b47-9fc0-376ccf6e3030 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276" status: 200 len: 1237 microversion: 2.1 time: 0.136072 Sep 02 05:33:17.618958 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 553/1107] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:17 2022] GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276 => generated 1237 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:17.994773 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-bcae7072-ef70-41f1-8b27-b0a1620f2d2f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:17.995709 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-bcae7072-ef70-41f1-8b27-b0a1620f2d2f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:18.010542 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-bcae7072-ef70-41f1-8b27-b0a1620f2d2f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:18.013141 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-bcae7072-ef70-41f1-8b27-b0a1620f2d2f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:18.014136 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-bcae7072-ef70-41f1-8b27-b0a1620f2d2f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:18.017217 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-bcae7072-ef70-41f1-8b27-b0a1620f2d2f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:18.020109 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-bcae7072-ef70-41f1-8b27-b0a1620f2d2f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:18.021630 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-bcae7072-ef70-41f1-8b27-b0a1620f2d2f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:18.220740 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-532f38fd-e12b-45f9-8d5f-00f9a24d75d7 req-735f1477-1af2-47b7-8c86-0caed607f361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d862d87f-85bc-4970-97b5-af0ff1b6ebf8", "name": "network-vif-plugged", "status": "completed", "tag": "47f28e65-04e5-4573-84d6-9faa45a85dd1"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:33:18.242936 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-532f38fd-e12b-45f9-8d5f-00f9a24d75d7 req-735f1477-1af2-47b7-8c86-0caed607f361 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:18.243939 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-532f38fd-e12b-45f9-8d5f-00f9a24d75d7 req-735f1477-1af2-47b7-8c86-0caed607f361 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:18.244682 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-532f38fd-e12b-45f9-8d5f-00f9a24d75d7 req-735f1477-1af2-47b7-8c86-0caed607f361 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:18.279832 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-532f38fd-e12b-45f9-8d5f-00f9a24d75d7 req-735f1477-1af2-47b7-8c86-0caed607f361 service nova] Creating event network-vif-plugged:47f28e65-04e5-4573-84d6-9faa45a85dd1 for instance d862d87f-85bc-4970-97b5-af0ff1b6ebf8 on hv-cinder-85391 Sep 02 05:33:18.287019 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-532f38fd-e12b-45f9-8d5f-00f9a24d75d7 req-735f1477-1af2-47b7-8c86-0caed607f361 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070662 Sep 02 05:33:18.288072 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 554/1108] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:33:18.419499 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-bcae7072-ef70-41f1-8b27-b0a1620f2d2f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:18.434604 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-bcae7072-ef70-41f1-8b27-b0a1620f2d2f tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1673 microversion: 2.1 time: 0.447146 Sep 02 05:33:18.438545 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 555/1109] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:17 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1673 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:18.503393 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-272d817d-2019-47b9-a78d-07be16ca564f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:18.506347 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-13b61654-1c2d-435c-8eed-7441955524c1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:18.507059 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-272d817d-2019-47b9-a78d-07be16ca564f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: 7b97865b-0582-4cf4-a4a7-d7aaa655251d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:18.510104 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-13b61654-1c2d-435c-8eed-7441955524c1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:18.535022 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-272d817d-2019-47b9-a78d-07be16ca564f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:18.535742 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-272d817d-2019-47b9-a78d-07be16ca564f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:18.537593 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-272d817d-2019-47b9-a78d-07be16ca564f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:18.538193 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-13b61654-1c2d-435c-8eed-7441955524c1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:18.539129 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-272d817d-2019-47b9-a78d-07be16ca564f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:18.539904 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-13b61654-1c2d-435c-8eed-7441955524c1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:18.540586 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-272d817d-2019-47b9-a78d-07be16ca564f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:18.541274 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-13b61654-1c2d-435c-8eed-7441955524c1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:18.541769 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-272d817d-2019-47b9-a78d-07be16ca564f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:18.542853 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-13b61654-1c2d-435c-8eed-7441955524c1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:18.543991 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-13b61654-1c2d-435c-8eed-7441955524c1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:18.545625 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-13b61654-1c2d-435c-8eed-7441955524c1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:19.145208 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-272d817d-2019-47b9-a78d-07be16ca564f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:19.155502 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-272d817d-2019-47b9-a78d-07be16ca564f tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d" status: 200 len: 1265 microversion: 2.1 time: 0.659142 Sep 02 05:33:19.156390 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 556/1110] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:18 2022] GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d => generated 1265 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:33:19.174188 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-590b4307-f549-4777-b025-5148f48801c1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:19.175038 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-590b4307-f549-4777-b025-5148f48801c1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 47d13255-9c47-4bba-a83c-1bba0adb6276] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:19.185097 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-590b4307-f549-4777-b025-5148f48801c1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:19.185939 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-590b4307-f549-4777-b025-5148f48801c1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:19.188638 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-590b4307-f549-4777-b025-5148f48801c1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:19.189575 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-590b4307-f549-4777-b025-5148f48801c1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:19.190202 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-590b4307-f549-4777-b025-5148f48801c1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:19.190802 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-590b4307-f549-4777-b025-5148f48801c1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:19.214919 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:33:19.264695 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-13b61654-1c2d-435c-8eed-7441955524c1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:19.274969 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-13b61654-1c2d-435c-8eed-7441955524c1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:19.277320 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-13b61654-1c2d-435c-8eed-7441955524c1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:19.278934 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-13b61654-1c2d-435c-8eed-7441955524c1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1743 microversion: 2.20 time: 0.788045 Sep 02 05:33:19.280657 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 555/1111] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:18 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1743 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:19.348418 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-590b4307-f549-4777-b025-5148f48801c1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:19.358661 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-590b4307-f549-4777-b025-5148f48801c1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276" status: 200 len: 1299 microversion: 2.1 time: 0.188806 Sep 02 05:33:19.372647 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 557/1112] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:19 2022] GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276 => generated 1299 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:19.461430 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-444b8746-abd1-45ff-a133-e22d5abe61e6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:19.462177 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-444b8746-abd1-45ff-a133-e22d5abe61e6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:19.471657 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-444b8746-abd1-45ff-a133-e22d5abe61e6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:19.472577 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-444b8746-abd1-45ff-a133-e22d5abe61e6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:19.473261 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-444b8746-abd1-45ff-a133-e22d5abe61e6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:19.474201 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-444b8746-abd1-45ff-a133-e22d5abe61e6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:19.474870 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-444b8746-abd1-45ff-a133-e22d5abe61e6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:19.475554 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-444b8746-abd1-45ff-a133-e22d5abe61e6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:19.985122 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-444b8746-abd1-45ff-a133-e22d5abe61e6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:19.996310 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-444b8746-abd1-45ff-a133-e22d5abe61e6 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1673 microversion: 2.1 time: 0.538782 Sep 02 05:33:19.997757 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 556/1113] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:19 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1673 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:33:20.180495 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-1b7583bc-6fac-436f-92ab-6d7c0b2fcced tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:20.181108 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-1b7583bc-6fac-436f-92ab-6d7c0b2fcced tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: 7b97865b-0582-4cf4-a4a7-d7aaa655251d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:20.194826 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1b7583bc-6fac-436f-92ab-6d7c0b2fcced tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:20.195839 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1b7583bc-6fac-436f-92ab-6d7c0b2fcced tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:20.196747 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1b7583bc-6fac-436f-92ab-6d7c0b2fcced tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:20.197018 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1b7583bc-6fac-436f-92ab-6d7c0b2fcced tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:20.204670 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1b7583bc-6fac-436f-92ab-6d7c0b2fcced tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:20.205798 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1b7583bc-6fac-436f-92ab-6d7c0b2fcced tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:20.736969 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-1b7583bc-6fac-436f-92ab-6d7c0b2fcced tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:20.751542 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-1b7583bc-6fac-436f-92ab-6d7c0b2fcced tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d" status: 200 len: 1265 microversion: 2.1 time: 0.571702 Sep 02 05:33:20.753335 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 558/1114] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:20 2022] GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d => generated 1265 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:20.770178 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-e01d32e6-ad6f-429d-854d-f73a4f70aa96 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:20.771702 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-e01d32e6-ad6f-429d-854d-f73a4f70aa96 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 47d13255-9c47-4bba-a83c-1bba0adb6276] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:20.789913 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e01d32e6-ad6f-429d-854d-f73a4f70aa96 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:20.803694 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e01d32e6-ad6f-429d-854d-f73a4f70aa96 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:20.804915 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e01d32e6-ad6f-429d-854d-f73a4f70aa96 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:20.805884 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e01d32e6-ad6f-429d-854d-f73a4f70aa96 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:20.808807 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e01d32e6-ad6f-429d-854d-f73a4f70aa96 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:20.809467 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e01d32e6-ad6f-429d-854d-f73a4f70aa96 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:20.948707 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-83e8a7ce-83e5-4a50-9229-28952db7825f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:20.950229 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-83e8a7ce-83e5-4a50-9229-28952db7825f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:20.971211 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-83e8a7ce-83e5-4a50-9229-28952db7825f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:20.971613 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-83e8a7ce-83e5-4a50-9229-28952db7825f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:20.972052 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-83e8a7ce-83e5-4a50-9229-28952db7825f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:20.975707 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-83e8a7ce-83e5-4a50-9229-28952db7825f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:20.978199 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-83e8a7ce-83e5-4a50-9229-28952db7825f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:20.978652 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-83e8a7ce-83e5-4a50-9229-28952db7825f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:21.028667 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=100 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:33:21.559082 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-e01d32e6-ad6f-429d-854d-f73a4f70aa96 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:21.580521 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-e01d32e6-ad6f-429d-854d-f73a4f70aa96 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276" status: 200 len: 1366 microversion: 2.1 time: 0.826035 Sep 02 05:33:21.581130 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 559/1115] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:20 2022] GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276 => generated 1366 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:21.598316 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-52a0c456-deb0-4017-a88f-ce7a01bd899f req-0fe994ad-a414-49d5-9366-ca265d7a9985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b97865b-0582-4cf4-a4a7-d7aaa655251d", "name": "network-vif-plugged", "status": "completed", "tag": "5143e5e1-5d0c-40d4-854f-4a447b64972c"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:33:21.610240 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-52a0c456-deb0-4017-a88f-ce7a01bd899f req-0fe994ad-a414-49d5-9366-ca265d7a9985 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:21.613603 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-52a0c456-deb0-4017-a88f-ce7a01bd899f req-0fe994ad-a414-49d5-9366-ca265d7a9985 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:21.624855 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-52a0c456-deb0-4017-a88f-ce7a01bd899f req-0fe994ad-a414-49d5-9366-ca265d7a9985 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:21.637708 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-52a0c456-deb0-4017-a88f-ce7a01bd899f req-0fe994ad-a414-49d5-9366-ca265d7a9985 service nova] Creating event network-vif-plugged:5143e5e1-5d0c-40d4-854f-4a447b64972c for instance 7b97865b-0582-4cf4-a4a7-d7aaa655251d on hv-cinder-85391 Sep 02 05:33:21.652603 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-52a0c456-deb0-4017-a88f-ce7a01bd899f req-0fe994ad-a414-49d5-9366-ca265d7a9985 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070040 Sep 02 05:33:21.653760 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 560/1116] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:33:21.660110 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-68f2c7b5-e212-43ab-b960-a4f8513e1fc4 req-dbb930f1-9491-4f00-9383-338a47d4344d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47d13255-9c47-4bba-a83c-1bba0adb6276", "tag": "a616ea50-2a64-424a-bca9-fc3358e11f91"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:33:21.675790 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-68f2c7b5-e212-43ab-b960-a4f8513e1fc4 req-dbb930f1-9491-4f00-9383-338a47d4344d service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:21.676591 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-68f2c7b5-e212-43ab-b960-a4f8513e1fc4 req-dbb930f1-9491-4f00-9383-338a47d4344d service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:21.678043 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-68f2c7b5-e212-43ab-b960-a4f8513e1fc4 req-dbb930f1-9491-4f00-9383-338a47d4344d service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:21.697625 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-68f2c7b5-e212-43ab-b960-a4f8513e1fc4 req-dbb930f1-9491-4f00-9383-338a47d4344d service nova] Creating event network-changed:a616ea50-2a64-424a-bca9-fc3358e11f91 for instance 47d13255-9c47-4bba-a83c-1bba0adb6276 on hv-cinder-85391 Sep 02 05:33:21.704391 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-68f2c7b5-e212-43ab-b960-a4f8513e1fc4 req-dbb930f1-9491-4f00-9383-338a47d4344d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048758 Sep 02 05:33:21.705208 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 561/1117] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:33:21.711398 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-c0bcc143-6a44-4cc4-a77c-f2e1a70cb9da tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:21.712103 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-c0bcc143-6a44-4cc4-a77c-f2e1a70cb9da tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:21.725070 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c0bcc143-6a44-4cc4-a77c-f2e1a70cb9da tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:21.726500 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c0bcc143-6a44-4cc4-a77c-f2e1a70cb9da tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:21.727107 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c0bcc143-6a44-4cc4-a77c-f2e1a70cb9da tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:21.729432 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 05:33:21.730976 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Fri Sep 2 05:33:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 (ip 10.222.0.30) !!! Sep 02 05:33:21.741090 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c0bcc143-6a44-4cc4-a77c-f2e1a70cb9da tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:21.742333 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c0bcc143-6a44-4cc4-a77c-f2e1a70cb9da tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:21.742921 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c0bcc143-6a44-4cc4-a77c-f2e1a70cb9da tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:21.786436 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c0bcc143-6a44-4cc4-a77c-f2e1a70cb9da tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:21.789194 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c0bcc143-6a44-4cc4-a77c-f2e1a70cb9da tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:21.789653 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c0bcc143-6a44-4cc4-a77c-f2e1a70cb9da tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:21.790109 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.objects.instance [None req-c0bcc143-6a44-4cc4-a77c-f2e1a70cb9da tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lazy-loading 'fault' on Instance uuid 387fc985-a99f-4805-ab55-641d3fe7cc27 {{(pid=120448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:33:21.811527 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-83e8a7ce-83e5-4a50-9229-28952db7825f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:21.847757 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-83e8a7ce-83e5-4a50-9229-28952db7825f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:21.860389 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-83e8a7ce-83e5-4a50-9229-28952db7825f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:21.861937 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-83e8a7ce-83e5-4a50-9229-28952db7825f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1738 microversion: 2.20 time: 1.563252 Sep 02 05:33:21.864349 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 557/1118] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:20 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1738 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:21.872920 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-e52c2521-b56c-4c5d-882e-a828d703d4b1 req-ba51bd6d-3539-40ac-bfaa-37e8124d3d60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "387fc985-a99f-4805-ab55-641d3fe7cc27", "name": "network-vif-deleted", "tag": "fb24bf1a-8f67-4eb6-b5bb-47d994b3c852"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:33:21.899999 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-e52c2521-b56c-4c5d-882e-a828d703d4b1 req-ba51bd6d-3539-40ac-bfaa-37e8124d3d60 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:21.902778 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-e52c2521-b56c-4c5d-882e-a828d703d4b1 req-ba51bd6d-3539-40ac-bfaa-37e8124d3d60 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:21.903420 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-e52c2521-b56c-4c5d-882e-a828d703d4b1 req-ba51bd6d-3539-40ac-bfaa-37e8124d3d60 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:21.937767 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-e52c2521-b56c-4c5d-882e-a828d703d4b1 req-ba51bd6d-3539-40ac-bfaa-37e8124d3d60 service nova] Creating event network-vif-deleted:fb24bf1a-8f67-4eb6-b5bb-47d994b3c852 for instance 387fc985-a99f-4805-ab55-641d3fe7cc27 on hv-cinder-85391 Sep 02 05:33:21.951585 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-e52c2521-b56c-4c5d-882e-a828d703d4b1 req-ba51bd6d-3539-40ac-bfaa-37e8124d3d60 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085967 Sep 02 05:33:21.956807 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 558/1119] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:33:21.967837 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5c9ecf3f-5466-420a-a4d2-da2adb2a0503 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:21.978282 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5c9ecf3f-5466-420a-a4d2-da2adb2a0503 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: 7b97865b-0582-4cf4-a4a7-d7aaa655251d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:21.991163 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5c9ecf3f-5466-420a-a4d2-da2adb2a0503 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:21.992948 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5c9ecf3f-5466-420a-a4d2-da2adb2a0503 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:21.993379 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5c9ecf3f-5466-420a-a4d2-da2adb2a0503 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:21.994093 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5c9ecf3f-5466-420a-a4d2-da2adb2a0503 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:21.994516 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5c9ecf3f-5466-420a-a4d2-da2adb2a0503 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:21.994938 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5c9ecf3f-5466-420a-a4d2-da2adb2a0503 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:22.056110 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c0bcc143-6a44-4cc4-a77c-f2e1a70cb9da tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:22.069476 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-c0bcc143-6a44-4cc4-a77c-f2e1a70cb9da tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1327 microversion: 2.1 time: 0.362383 Sep 02 05:33:22.071262 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 562/1120] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:21 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1327 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:22.601453 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-332a663c-be81-4ea6-9be5-f85509e9c60d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:22.602073 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-332a663c-be81-4ea6-9be5-f85509e9c60d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 47d13255-9c47-4bba-a83c-1bba0adb6276] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:22.614776 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-332a663c-be81-4ea6-9be5-f85509e9c60d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:22.615532 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-332a663c-be81-4ea6-9be5-f85509e9c60d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:22.616162 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-332a663c-be81-4ea6-9be5-f85509e9c60d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:22.617597 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-332a663c-be81-4ea6-9be5-f85509e9c60d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:22.618695 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-332a663c-be81-4ea6-9be5-f85509e9c60d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:22.619274 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-332a663c-be81-4ea6-9be5-f85509e9c60d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:22.798159 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5c9ecf3f-5466-420a-a4d2-da2adb2a0503 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:22.805581 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell0:SELECT=4 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:33:22.808563 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5c9ecf3f-5466-420a-a4d2-da2adb2a0503 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d" status: 200 len: 1265 microversion: 2.1 time: 0.850314 Sep 02 05:33:22.820859 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 559/1121] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:21 2022] GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d => generated 1265 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:22.885464 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-345961f2-8bf6-4458-9fbb-8b540bcb565b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:22.886793 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-345961f2-8bf6-4458-9fbb-8b540bcb565b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:22.896063 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-345961f2-8bf6-4458-9fbb-8b540bcb565b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:22.896869 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-345961f2-8bf6-4458-9fbb-8b540bcb565b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:22.897653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-345961f2-8bf6-4458-9fbb-8b540bcb565b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:22.898526 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-345961f2-8bf6-4458-9fbb-8b540bcb565b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:22.899134 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-345961f2-8bf6-4458-9fbb-8b540bcb565b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:22.899715 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-345961f2-8bf6-4458-9fbb-8b540bcb565b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:22.979763 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-332a663c-be81-4ea6-9be5-f85509e9c60d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:22.998196 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-332a663c-be81-4ea6-9be5-f85509e9c60d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276" status: 200 len: 1366 microversion: 2.1 time: 0.400917 Sep 02 05:33:23.000806 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 563/1122] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:22 2022] GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276 => generated 1366 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:33:23.092242 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-c3b98b7f-5b0b-47a8-922e-1e19aada1381 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:23.093197 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-c3b98b7f-5b0b-47a8-922e-1e19aada1381 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:23.100178 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c3b98b7f-5b0b-47a8-922e-1e19aada1381 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:23.100906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c3b98b7f-5b0b-47a8-922e-1e19aada1381 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:23.101527 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c3b98b7f-5b0b-47a8-922e-1e19aada1381 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:23.102556 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c3b98b7f-5b0b-47a8-922e-1e19aada1381 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:23.103619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c3b98b7f-5b0b-47a8-922e-1e19aada1381 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:23.104250 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c3b98b7f-5b0b-47a8-922e-1e19aada1381 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:23.152992 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c3b98b7f-5b0b-47a8-922e-1e19aada1381 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:23.153720 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c3b98b7f-5b0b-47a8-922e-1e19aada1381 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:23.154391 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c3b98b7f-5b0b-47a8-922e-1e19aada1381 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:23.155260 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.objects.instance [None req-c3b98b7f-5b0b-47a8-922e-1e19aada1381 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lazy-loading 'fault' on Instance uuid 387fc985-a99f-4805-ab55-641d3fe7cc27 {{(pid=120448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:33:23.244110 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c3b98b7f-5b0b-47a8-922e-1e19aada1381 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:23.248243 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-345961f2-8bf6-4458-9fbb-8b540bcb565b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:23.257343 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-c3b98b7f-5b0b-47a8-922e-1e19aada1381 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1327 microversion: 2.1 time: 0.168659 Sep 02 05:33:23.260446 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 564/1123] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:23 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1327 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:33:23.261405 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-345961f2-8bf6-4458-9fbb-8b540bcb565b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:23.263086 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-345961f2-8bf6-4458-9fbb-8b540bcb565b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:23.264520 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-345961f2-8bf6-4458-9fbb-8b540bcb565b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1738 microversion: 2.20 time: 0.383057 Sep 02 05:33:23.281510 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 560/1124] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:22 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1738 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:23.841248 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-40f807f8-0afa-47be-9572-44412f421b55 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:23.842409 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-40f807f8-0afa-47be-9572-44412f421b55 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: 7b97865b-0582-4cf4-a4a7-d7aaa655251d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:23.855017 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-40f807f8-0afa-47be-9572-44412f421b55 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:23.855730 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-40f807f8-0afa-47be-9572-44412f421b55 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:23.856401 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-40f807f8-0afa-47be-9572-44412f421b55 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:23.861661 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-40f807f8-0afa-47be-9572-44412f421b55 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:23.862141 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-40f807f8-0afa-47be-9572-44412f421b55 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:23.862585 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-40f807f8-0afa-47be-9572-44412f421b55 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:24.021081 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-eebcf159-5900-434b-af59-e9a5fb86acc1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:24.022004 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-eebcf159-5900-434b-af59-e9a5fb86acc1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 47d13255-9c47-4bba-a83c-1bba0adb6276] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:24.041431 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-eebcf159-5900-434b-af59-e9a5fb86acc1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:24.041964 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-eebcf159-5900-434b-af59-e9a5fb86acc1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:24.043655 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-eebcf159-5900-434b-af59-e9a5fb86acc1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:24.046897 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-eebcf159-5900-434b-af59-e9a5fb86acc1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:24.047571 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-eebcf159-5900-434b-af59-e9a5fb86acc1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:24.051667 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-eebcf159-5900-434b-af59-e9a5fb86acc1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:24.148981 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-40f807f8-0afa-47be-9572-44412f421b55 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:24.160934 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-40f807f8-0afa-47be-9572-44412f421b55 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d" status: 200 len: 1265 microversion: 2.1 time: 0.321552 Sep 02 05:33:24.175293 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 565/1125] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:23 2022] GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d => generated 1265 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:24.282112 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-11fcebd0-e97b-4846-873f-bcc74f8eeaa1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:24.282645 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-11fcebd0-e97b-4846-873f-bcc74f8eeaa1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:24.293907 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-11fcebd0-e97b-4846-873f-bcc74f8eeaa1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:24.294409 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-11fcebd0-e97b-4846-873f-bcc74f8eeaa1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:24.294852 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-11fcebd0-e97b-4846-873f-bcc74f8eeaa1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:24.295569 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-11fcebd0-e97b-4846-873f-bcc74f8eeaa1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:24.298456 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-11fcebd0-e97b-4846-873f-bcc74f8eeaa1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:24.301748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-11fcebd0-e97b-4846-873f-bcc74f8eeaa1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:24.330305 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-eebcf159-5900-434b-af59-e9a5fb86acc1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:24.352210 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-eebcf159-5900-434b-af59-e9a5fb86acc1 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276" status: 200 len: 1366 microversion: 2.1 time: 0.331761 Sep 02 05:33:24.353466 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 561/1126] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:24 2022] GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276 => generated 1366 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:33:24.364385 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ea1dbe42-9310-490d-8031-1d5f15b95201 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:24.368531 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-ea1dbe42-9310-490d-8031-1d5f15b95201 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:24.375600 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-11fcebd0-e97b-4846-873f-bcc74f8eeaa1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:24.376281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-11fcebd0-e97b-4846-873f-bcc74f8eeaa1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:24.376983 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-11fcebd0-e97b-4846-873f-bcc74f8eeaa1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:24.379203 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.objects.instance [None req-11fcebd0-e97b-4846-873f-bcc74f8eeaa1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lazy-loading 'fault' on Instance uuid 387fc985-a99f-4805-ab55-641d3fe7cc27 {{(pid=120448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:33:24.385421 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ea1dbe42-9310-490d-8031-1d5f15b95201 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:24.390505 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ea1dbe42-9310-490d-8031-1d5f15b95201 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:24.391080 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ea1dbe42-9310-490d-8031-1d5f15b95201 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:24.392698 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ea1dbe42-9310-490d-8031-1d5f15b95201 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:24.393361 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ea1dbe42-9310-490d-8031-1d5f15b95201 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:24.393953 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ea1dbe42-9310-490d-8031-1d5f15b95201 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:24.529401 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-11fcebd0-e97b-4846-873f-bcc74f8eeaa1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:24.537992 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-11fcebd0-e97b-4846-873f-bcc74f8eeaa1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 200 len: 1327 microversion: 2.1 time: 0.260933 Sep 02 05:33:24.555964 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 566/1127] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:24 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 1327 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:33:24.678864 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ea1dbe42-9310-490d-8031-1d5f15b95201 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:24.692426 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ea1dbe42-9310-490d-8031-1d5f15b95201 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:24.695599 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ea1dbe42-9310-490d-8031-1d5f15b95201 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:24.699822 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-ea1dbe42-9310-490d-8031-1d5f15b95201 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1738 microversion: 2.20 time: 0.342742 Sep 02 05:33:24.700649 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 562/1128] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:24 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1738 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:25.182081 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-90487d67-1d34-44a3-be51-60cced4b1720 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:25.182690 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-90487d67-1d34-44a3-be51-60cced4b1720 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: 7b97865b-0582-4cf4-a4a7-d7aaa655251d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:25.191039 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-90487d67-1d34-44a3-be51-60cced4b1720 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:25.191878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-90487d67-1d34-44a3-be51-60cced4b1720 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:25.197598 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-90487d67-1d34-44a3-be51-60cced4b1720 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:25.199580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-90487d67-1d34-44a3-be51-60cced4b1720 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:25.201218 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-90487d67-1d34-44a3-be51-60cced4b1720 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:25.202241 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-90487d67-1d34-44a3-be51-60cced4b1720 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:25.380401 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-d62dd0a7-d413-4c6d-acc5-7d1e3330ca3c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:25.389028 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-d62dd0a7-d413-4c6d-acc5-7d1e3330ca3c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 47d13255-9c47-4bba-a83c-1bba0adb6276] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:25.396990 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d62dd0a7-d413-4c6d-acc5-7d1e3330ca3c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:25.397634 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d62dd0a7-d413-4c6d-acc5-7d1e3330ca3c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:25.398180 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d62dd0a7-d413-4c6d-acc5-7d1e3330ca3c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:25.402378 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d62dd0a7-d413-4c6d-acc5-7d1e3330ca3c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:25.402994 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d62dd0a7-d413-4c6d-acc5-7d1e3330ca3c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:25.403536 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d62dd0a7-d413-4c6d-acc5-7d1e3330ca3c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:25.641784 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-90487d67-1d34-44a3-be51-60cced4b1720 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:25.654020 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-90487d67-1d34-44a3-be51-60cced4b1720 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d" status: 200 len: 1265 microversion: 2.1 time: 0.475860 Sep 02 05:33:25.658994 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 567/1129] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:25 2022] GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d => generated 1265 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:25.682440 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-3c32ed7d-44b3-417f-854c-a17bc767bc10 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:25.683079 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-3c32ed7d-44b3-417f-854c-a17bc767bc10 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:25.696211 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3c32ed7d-44b3-417f-854c-a17bc767bc10 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:25.696211 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3c32ed7d-44b3-417f-854c-a17bc767bc10 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:25.696211 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3c32ed7d-44b3-417f-854c-a17bc767bc10 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:25.696211 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3c32ed7d-44b3-417f-854c-a17bc767bc10 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:25.702913 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3c32ed7d-44b3-417f-854c-a17bc767bc10 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:25.703525 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3c32ed7d-44b3-417f-854c-a17bc767bc10 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:25.728226 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.wsgi [None req-3c32ed7d-44b3-417f-854c-a17bc767bc10 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] HTTP exception thrown: Instance 387fc985-a99f-4805-ab55-641d3fe7cc27 could not be found. Sep 02 05:33:25.729900 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-3c32ed7d-44b3-417f-854c-a17bc767bc10 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Request method failure captured: Sep 02 05:33:25.729900 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: request: GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 HTTP/1.1 Sep 02 05:33:25.729900 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept: application/json Sep 02 05:33:25.729900 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept-Encoding: identity Sep 02 05:33:25.729900 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Connection: close Sep 02 05:33:25.729900 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Length: 0 Sep 02 05:33:25.729900 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Type: application/json Sep 02 05:33:25.729900 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Host: 10.222.0.30 Sep 02 05:33:25.729900 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Openstack-System-Scope: None Sep 02 05:33:25.729900 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: User-Agent: python-urllib3/1.26.12 Sep 02 05:33:25.729900 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Auth-Token: gAAAAABjEZO5ixJTZLz6GGk-3Cr-UsnGjf2fgRdovThyegYcUwGTIuBtMMuCdgeKbQJIaRTwe1ps114Qxla8kszN3d3AeK9Ge4SGm55AldIpFwEAQsLBxnADifS_DFBEUjAuZ9KNqgx7fINlHDitlJoBTKxbiT90OE1W6K8UclbDQ4rqPrHqm2A Sep 02 05:33:25.729900 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Id: None Sep 02 05:33:25.729900 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Name: None Sep 02 05:33:25.729900 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Identity-Status: Confirmed Sep 02 05:33:25.729900 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Is-Admin-Project: True Sep 02 05:33:25.729900 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Id: default Sep 02 05:33:25.729900 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Name: Default Sep 02 05:33:25.729900 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Id: 88b420db5aef422b9ea85708c2d8e108 Sep 02 05:33:25.729900 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Name: tempest-AttachVolumeTestJSON-706896050 Sep 02 05:33:25.729900 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Role: member,reader Sep 02 05:33:25.729900 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Roles: member,reader Sep 02 05:33:25.731628 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_88b420db5aef422b9ea85708c2d8e108"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/88b420db5aef422b9ea85708c2d8e108"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/88b420db5aef422b9ea85708c2d8e108"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/88b420db5aef422b9ea85708c2d8e108"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:33:25.731628 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant: tempest-AttachVolumeTestJSON-706896050 Sep 02 05:33:25.731628 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Id: 88b420db5aef422b9ea85708c2d8e108 Sep 02 05:33:25.731628 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Name: tempest-AttachVolumeTestJSON-706896050 Sep 02 05:33:25.731628 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User: tempest-AttachVolumeTestJSON-706896050-project Sep 02 05:33:25.731628 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Id: default Sep 02 05:33:25.731628 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Name: Default Sep 02 05:33:25.731628 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Id: bdba1dc4a5e9482cb4eb94d914c108bf Sep 02 05:33:25.731628 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Name: tempest-AttachVolumeTestJSON-706896050-project Sep 02 05:33:25.731628 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: method: > Sep 02 05:33:25.731628 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: exception: Instance 387fc985-a99f-4805-ab55-641d3fe7cc27 could not be found. Sep 02 05:33:25.731628 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: action_args: {'id': '387fc985-a99f-4805-ab55-641d3fe7cc27'} Sep 02 05:33:25.732626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:33:25.732626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:33:25.732626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:33:25.732626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:33:25.732626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:33:25.732626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:33:25.732626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:33:25.732626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:33:25.732626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:33:25.732626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:33:25.732626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 387fc985-a99f-4805-ab55-641d3fe7cc27 could not be found. Sep 02 05:33:25.732626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:33:25.732626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:33:25.732626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:33:25.732626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:33:25.732626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:33:25.732626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:33:25.732626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:33:25.732626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:33:25.732626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:33:25.734406 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:33:25.734406 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:33:25.734406 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:33:25.734406 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:33:25.734406 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:33:25.734406 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:33:25.734406 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:33:25.734406 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 387fc985-a99f-4805-ab55-641d3fe7cc27 could not be found. Sep 02 05:33:25.734406 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:33:25.734406 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:33:25.734406 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:33:25.734406 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:33:25.734406 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:33:25.734406 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:33:25.734406 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:33:25.734406 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:33:25.734406 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 387fc985-a99f-4805-ab55-641d3fe7cc27 could not be found. Sep 02 05:33:25.734406 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:33:25.737007 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-3c32ed7d-44b3-417f-854c-a17bc767bc10 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Returning 404 to user: Instance 387fc985-a99f-4805-ab55-641d3fe7cc27 could not be found. {{(pid=120448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:33:25.737007 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-3c32ed7d-44b3-417f-854c-a17bc767bc10 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 404 len: 111 microversion: 2.1 time: 0.071042 Sep 02 05:33:25.743158 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-d62dd0a7-d413-4c6d-acc5-7d1e3330ca3c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:25.746325 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 568/1130] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:25 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:33:25.751468 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-804b2aea-bac8-430d-b59c-a69af6c8431a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:25.752091 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-804b2aea-bac8-430d-b59c-a69af6c8431a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:25.756735 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-d62dd0a7-d413-4c6d-acc5-7d1e3330ca3c tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276" status: 200 len: 1366 microversion: 2.1 time: 0.383991 Sep 02 05:33:25.757319 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 563/1131] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:25 2022] GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276 => generated 1366 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:25.763154 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-76231b34-b7f8-423d-9700-2b2208e5ea71 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '.version_select at 0x7fc90b4da040>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:25.780735 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell0:SELECT=2 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:33:25.782293 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:33:25.786238 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-804b2aea-bac8-430d-b59c-a69af6c8431a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:25.787396 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-804b2aea-bac8-430d-b59c-a69af6c8431a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:25.787984 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-804b2aea-bac8-430d-b59c-a69af6c8431a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:25.788892 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-804b2aea-bac8-430d-b59c-a69af6c8431a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:25.789497 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-804b2aea-bac8-430d-b59c-a69af6c8431a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:25.790087 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-804b2aea-bac8-430d-b59c-a69af6c8431a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:25.814920 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-76231b34-b7f8-423d-9700-2b2208e5ea71 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-664783107" status: 202 len: 0 microversion: 2.1 time: 0.055434 Sep 02 05:33:25.815851 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 564/1132] 10.222.0.30 () {58 vars in 1218 bytes} [Fri Sep 2 05:33:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-664783107 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:33:26.134675 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-804b2aea-bac8-430d-b59c-a69af6c8431a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:26.154391 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-804b2aea-bac8-430d-b59c-a69af6c8431a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:26.159807 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-804b2aea-bac8-430d-b59c-a69af6c8431a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:26.165558 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-804b2aea-bac8-430d-b59c-a69af6c8431a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1738 microversion: 2.20 time: 0.417776 Sep 02 05:33:26.166491 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 569/1133] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:25 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1738 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:26.678885 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-fc226a88-5b51-4371-b0c9-4186273e2121 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:26.679653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-fc226a88-5b51-4371-b0c9-4186273e2121 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: 7b97865b-0582-4cf4-a4a7-d7aaa655251d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:26.691643 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fc226a88-5b51-4371-b0c9-4186273e2121 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:26.695117 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fc226a88-5b51-4371-b0c9-4186273e2121 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:26.698922 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fc226a88-5b51-4371-b0c9-4186273e2121 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:26.699992 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fc226a88-5b51-4371-b0c9-4186273e2121 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:26.703957 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fc226a88-5b51-4371-b0c9-4186273e2121 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:26.704662 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fc226a88-5b51-4371-b0c9-4186273e2121 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:26.781811 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-e79cb1bd-43fd-46df-a318-dfae43cf8f74 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:26.782996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-e79cb1bd-43fd-46df-a318-dfae43cf8f74 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 47d13255-9c47-4bba-a83c-1bba0adb6276] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:26.785720 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell0:SELECT=8 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:33:26.803918 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e79cb1bd-43fd-46df-a318-dfae43cf8f74 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:26.806872 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e79cb1bd-43fd-46df-a318-dfae43cf8f74 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:26.807513 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e79cb1bd-43fd-46df-a318-dfae43cf8f74 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:26.811572 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e79cb1bd-43fd-46df-a318-dfae43cf8f74 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:26.812081 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e79cb1bd-43fd-46df-a318-dfae43cf8f74 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:26.812551 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e79cb1bd-43fd-46df-a318-dfae43cf8f74 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:27.233649 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-fc226a88-5b51-4371-b0c9-4186273e2121 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:27.244461 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-fc226a88-5b51-4371-b0c9-4186273e2121 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d" status: 200 len: 1451 microversion: 2.1 time: 0.569338 Sep 02 05:33:27.252265 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 565/1134] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:26 2022] GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d => generated 1451 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:27.257305 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-e85f211f-d347-4da7-834c-9dd0832e51ec req-1ea50931-9ea2-4db3-8477-90718c495a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47d13255-9c47-4bba-a83c-1bba0adb6276", "name": "network-vif-plugged", "status": "completed", "tag": "a616ea50-2a64-424a-bca9-fc3358e11f91"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:33:27.277991 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-e85f211f-d347-4da7-834c-9dd0832e51ec req-1ea50931-9ea2-4db3-8477-90718c495a4e service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:27.278729 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-e85f211f-d347-4da7-834c-9dd0832e51ec req-1ea50931-9ea2-4db3-8477-90718c495a4e service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:27.279201 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-e85f211f-d347-4da7-834c-9dd0832e51ec req-1ea50931-9ea2-4db3-8477-90718c495a4e service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:27.299475 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-e85f211f-d347-4da7-834c-9dd0832e51ec req-1ea50931-9ea2-4db3-8477-90718c495a4e service nova] Creating event network-vif-plugged:a616ea50-2a64-424a-bca9-fc3358e11f91 for instance 47d13255-9c47-4bba-a83c-1bba0adb6276 on hv-cinder-85391 Sep 02 05:33:27.313919 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-e85f211f-d347-4da7-834c-9dd0832e51ec req-1ea50931-9ea2-4db3-8477-90718c495a4e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060041 Sep 02 05:33:27.314525 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 566/1135] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:33:27.321239 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-28e561a6-cb41-4bfc-b555-3e50db671f74 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:27.325154 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-28e561a6-cb41-4bfc-b555-3e50db671f74 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:27.343389 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-28e561a6-cb41-4bfc-b555-3e50db671f74 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:27.344543 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-28e561a6-cb41-4bfc-b555-3e50db671f74 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:27.345619 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-28e561a6-cb41-4bfc-b555-3e50db671f74 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:27.346575 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-28e561a6-cb41-4bfc-b555-3e50db671f74 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:27.348574 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-28e561a6-cb41-4bfc-b555-3e50db671f74 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:27.350113 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-28e561a6-cb41-4bfc-b555-3e50db671f74 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:27.352243 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-e79cb1bd-43fd-46df-a318-dfae43cf8f74 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:27.360339 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-e79cb1bd-43fd-46df-a318-dfae43cf8f74 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276" status: 200 len: 1366 microversion: 2.1 time: 0.584931 Sep 02 05:33:27.364596 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 570/1136] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:26 2022] GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276 => generated 1366 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:27.381803 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-883a7de9-2efa-4ffd-87a5-eb550e67bde8 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:27.383746 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-883a7de9-2efa-4ffd-87a5-eb550e67bde8 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: 7b97865b-0582-4cf4-a4a7-d7aaa655251d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:27.400554 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-883a7de9-2efa-4ffd-87a5-eb550e67bde8 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:27.401989 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-883a7de9-2efa-4ffd-87a5-eb550e67bde8 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:27.413951 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-883a7de9-2efa-4ffd-87a5-eb550e67bde8 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:27.415862 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-883a7de9-2efa-4ffd-87a5-eb550e67bde8 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:27.418241 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-883a7de9-2efa-4ffd-87a5-eb550e67bde8 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:27.419069 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-883a7de9-2efa-4ffd-87a5-eb550e67bde8 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:27.588440 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-28e561a6-cb41-4bfc-b555-3e50db671f74 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:27.604932 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-28e561a6-cb41-4bfc-b555-3e50db671f74 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:27.606993 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-28e561a6-cb41-4bfc-b555-3e50db671f74 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:27.608928 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-28e561a6-cb41-4bfc-b555-3e50db671f74 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1738 microversion: 2.20 time: 0.293152 Sep 02 05:33:27.610078 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 567/1137] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:27 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1738 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:27.615253 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-cf868766-e2cb-4fef-b249-e58dd4e53029 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Action: 'create', calling method: .version_select at 0x7fc90b799dc0>, body: {"keypair": {"name": "tempest-keypair-918377955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDl8BMt8uv4hDiouSrp4LG9U99pZ2Z13X1mkqcbLMY7ibpXgBCFcxKQDV2pAhXHzUWe4sNBCOLVPcDuayzPJyGfOHGdN46NsWm/SOAIrjbDIZs/4OdWAfokU1d+o2k9sjQ=="}} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:33:27.631623 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.quota [None req-cf868766-e2cb-4fef-b249-e58dd4e53029 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Getting quotas for project 88b420db5aef422b9ea85708c2d8e108. Resources: {'key_pairs'} {{(pid=120449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:33:27.636104 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.quota [None req-cf868766-e2cb-4fef-b249-e58dd4e53029 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Getting quotas for user bdba1dc4a5e9482cb4eb94d914c108bf and project 88b420db5aef422b9ea85708c2d8e108. Resources: {'key_pairs'} {{(pid=120449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:33:27.667589 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-cf868766-e2cb-4fef-b249-e58dd4e53029 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055636 Sep 02 05:33:27.668899 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 568/1138] 10.222.0.30 () {60 vars in 1159 bytes} [Fri Sep 2 05:33:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:33:27.696240 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-883a7de9-2efa-4ffd-87a5-eb550e67bde8 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:27.704935 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-883a7de9-2efa-4ffd-87a5-eb550e67bde8 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d" status: 200 len: 1451 microversion: 2.1 time: 0.338992 Sep 02 05:33:27.705515 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 571/1139] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:27 2022] GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d => generated 1451 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:28.384511 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-b4f2db44-9c52-4d05-b8ec-7d606c44f181 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:28.385231 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-b4f2db44-9c52-4d05-b8ec-7d606c44f181 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 47d13255-9c47-4bba-a83c-1bba0adb6276] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:28.396520 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:33:28.398994 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b4f2db44-9c52-4d05-b8ec-7d606c44f181 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:28.399701 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b4f2db44-9c52-4d05-b8ec-7d606c44f181 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:28.401543 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b4f2db44-9c52-4d05-b8ec-7d606c44f181 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:28.402497 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b4f2db44-9c52-4d05-b8ec-7d606c44f181 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:28.404968 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b4f2db44-9c52-4d05-b8ec-7d606c44f181 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:28.410751 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b4f2db44-9c52-4d05-b8ec-7d606c44f181 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:28.643501 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-595d053d-bfdc-4073-8437-a1fe00d8d496 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:28.645264 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-595d053d-bfdc-4073-8437-a1fe00d8d496 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:28.658667 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-595d053d-bfdc-4073-8437-a1fe00d8d496 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:28.659165 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-595d053d-bfdc-4073-8437-a1fe00d8d496 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:28.659600 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-595d053d-bfdc-4073-8437-a1fe00d8d496 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:28.660353 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-595d053d-bfdc-4073-8437-a1fe00d8d496 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:28.660805 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-595d053d-bfdc-4073-8437-a1fe00d8d496 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:28.661242 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-595d053d-bfdc-4073-8437-a1fe00d8d496 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:28.803119 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-b4f2db44-9c52-4d05-b8ec-7d606c44f181 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:28.821058 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-b4f2db44-9c52-4d05-b8ec-7d606c44f181 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276" status: 200 len: 1366 microversion: 2.1 time: 0.440397 Sep 02 05:33:28.822261 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 569/1140] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:28 2022] GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276 => generated 1366 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:29.039595 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-595d053d-bfdc-4073-8437-a1fe00d8d496 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:29.055763 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-595d053d-bfdc-4073-8437-a1fe00d8d496 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:29.057594 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-595d053d-bfdc-4073-8437-a1fe00d8d496 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:29.060100 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-595d053d-bfdc-4073-8437-a1fe00d8d496 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1738 microversion: 2.20 time: 0.419993 Sep 02 05:33:29.068205 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 572/1141] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:28 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1738 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:29.845010 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-df99b16a-5ddf-4faf-970c-639c65cfa02e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:29.846345 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-df99b16a-5ddf-4faf-970c-639c65cfa02e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 47d13255-9c47-4bba-a83c-1bba0adb6276] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:29.878771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-df99b16a-5ddf-4faf-970c-639c65cfa02e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:29.879675 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-df99b16a-5ddf-4faf-970c-639c65cfa02e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:29.880383 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-df99b16a-5ddf-4faf-970c-639c65cfa02e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:29.881939 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-df99b16a-5ddf-4faf-970c-639c65cfa02e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:29.882656 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-df99b16a-5ddf-4faf-970c-639c65cfa02e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:29.883306 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-df99b16a-5ddf-4faf-970c-639c65cfa02e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:30.090154 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-00ba462d-aa54-4c65-b990-9175566cf791 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:30.092692 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-00ba462d-aa54-4c65-b990-9175566cf791 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:30.119985 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-00ba462d-aa54-4c65-b990-9175566cf791 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:30.128568 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-00ba462d-aa54-4c65-b990-9175566cf791 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:30.129486 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-00ba462d-aa54-4c65-b990-9175566cf791 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:30.130537 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-00ba462d-aa54-4c65-b990-9175566cf791 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:30.140748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-00ba462d-aa54-4c65-b990-9175566cf791 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:30.141590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-00ba462d-aa54-4c65-b990-9175566cf791 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:30.586379 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-df99b16a-5ddf-4faf-970c-639c65cfa02e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:30.605786 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-df99b16a-5ddf-4faf-970c-639c65cfa02e tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276" status: 200 len: 1555 microversion: 2.1 time: 0.766490 Sep 02 05:33:30.608703 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 570/1142] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:29 2022] GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276 => generated 1555 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:30.634161 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-4fbf7435-4aec-43c4-96d2-166bb690881d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:30.634976 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-4fbf7435-4aec-43c4-96d2-166bb690881d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 47d13255-9c47-4bba-a83c-1bba0adb6276] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:30.643832 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4fbf7435-4aec-43c4-96d2-166bb690881d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:30.645870 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4fbf7435-4aec-43c4-96d2-166bb690881d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:30.648776 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4fbf7435-4aec-43c4-96d2-166bb690881d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:30.649750 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4fbf7435-4aec-43c4-96d2-166bb690881d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:30.650388 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4fbf7435-4aec-43c4-96d2-166bb690881d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:30.659001 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4fbf7435-4aec-43c4-96d2-166bb690881d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:30.872470 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-00ba462d-aa54-4c65-b990-9175566cf791 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:30.890040 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-00ba462d-aa54-4c65-b990-9175566cf791 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:30.891925 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-00ba462d-aa54-4c65-b990-9175566cf791 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:30.895289 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-00ba462d-aa54-4c65-b990-9175566cf791 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1738 microversion: 2.20 time: 0.813017 Sep 02 05:33:30.898951 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 573/1143] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:30 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1738 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:30.910648 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-4301d20a-2d20-4634-a99d-15fe38affa03 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1337666223", "imageRef": "f3669111-2e3f-4f39-878f-19d263505eaa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "239438af-7bb7-4d71-98ef-7302bb97e27b"}], "security_groups": [{"name": "tempest-securitygroup--1074764915"}], "key_name": "tempest-keypair-918377955", "user_data": "}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:33:30.918066 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-4fbf7435-4aec-43c4-96d2-166bb690881d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.291120 Sep 02 05:33:30.919699 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 571/1144] 10.222.0.30 () {58 vars in 1275 bytes} [Fri Sep 2 05:33:30 2022] GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276/os-interface => generated 284 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:33:31.687405 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-bf56a553-2644-4975-8cf7-9ab6fce46845 req-d63e85ba-d6df-40d5-b91f-6ece26e7cc0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b97865b-0582-4cf4-a4a7-d7aaa655251d", "tag": "5143e5e1-5d0c-40d4-854f-4a447b64972c"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:33:31.713796 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-bf56a553-2644-4975-8cf7-9ab6fce46845 req-d63e85ba-d6df-40d5-b91f-6ece26e7cc0d service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:31.714586 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-bf56a553-2644-4975-8cf7-9ab6fce46845 req-d63e85ba-d6df-40d5-b91f-6ece26e7cc0d service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:31.715192 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-bf56a553-2644-4975-8cf7-9ab6fce46845 req-d63e85ba-d6df-40d5-b91f-6ece26e7cc0d service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:31.738981 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-bf56a553-2644-4975-8cf7-9ab6fce46845 req-d63e85ba-d6df-40d5-b91f-6ece26e7cc0d service nova] Creating event network-changed:5143e5e1-5d0c-40d4-854f-4a447b64972c for instance 7b97865b-0582-4cf4-a4a7-d7aaa655251d on hv-cinder-85391 Sep 02 05:33:31.774152 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-bf56a553-2644-4975-8cf7-9ab6fce46845 req-d63e85ba-d6df-40d5-b91f-6ece26e7cc0d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091120 Sep 02 05:33:31.781981 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 572/1145] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:33:31.926562 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-1d2c6c48-f62e-4e9b-8f0f-9cc4f51d905c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:31.928103 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-1d2c6c48-f62e-4e9b-8f0f-9cc4f51d905c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:31.942022 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1d2c6c48-f62e-4e9b-8f0f-9cc4f51d905c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:31.954093 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1d2c6c48-f62e-4e9b-8f0f-9cc4f51d905c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:31.957180 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1d2c6c48-f62e-4e9b-8f0f-9cc4f51d905c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:31.958547 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1d2c6c48-f62e-4e9b-8f0f-9cc4f51d905c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:31.963756 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1d2c6c48-f62e-4e9b-8f0f-9cc4f51d905c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:31.966127 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1d2c6c48-f62e-4e9b-8f0f-9cc4f51d905c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:32.455266 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1d2c6c48-f62e-4e9b-8f0f-9cc4f51d905c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:32.464988 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1d2c6c48-f62e-4e9b-8f0f-9cc4f51d905c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:32.466450 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1d2c6c48-f62e-4e9b-8f0f-9cc4f51d905c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:32.467730 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-1d2c6c48-f62e-4e9b-8f0f-9cc4f51d905c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1738 microversion: 2.20 time: 0.546838 Sep 02 05:33:32.477174 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 573/1146] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:31 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1738 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:33:33.499394 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-82f45036-d741-41d8-9eb1-2c52bece9676 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:33.500044 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-82f45036-d741-41d8-9eb1-2c52bece9676 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:33.519479 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-82f45036-d741-41d8-9eb1-2c52bece9676 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:33.519981 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-82f45036-d741-41d8-9eb1-2c52bece9676 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:33.526542 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-82f45036-d741-41d8-9eb1-2c52bece9676 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:33.527362 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-82f45036-d741-41d8-9eb1-2c52bece9676 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:33.527853 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-82f45036-d741-41d8-9eb1-2c52bece9676 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:33.532594 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-82f45036-d741-41d8-9eb1-2c52bece9676 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:34.376689 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-82f45036-d741-41d8-9eb1-2c52bece9676 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:34.396047 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-82f45036-d741-41d8-9eb1-2c52bece9676 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:34.398753 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-82f45036-d741-41d8-9eb1-2c52bece9676 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:34.405478 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-82f45036-d741-41d8-9eb1-2c52bece9676 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1738 microversion: 2.20 time: 0.909077 Sep 02 05:33:34.408651 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 574/1147] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:33 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1738 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:34.614355 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-f89b74d1-7640-4c2b-b292-c728000da435 req-91cb7e4f-fc94-407a-a07a-3205427a5849 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47d13255-9c47-4bba-a83c-1bba0adb6276", "tag": "a616ea50-2a64-424a-bca9-fc3358e11f91"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:33:34.638463 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-f89b74d1-7640-4c2b-b292-c728000da435 req-91cb7e4f-fc94-407a-a07a-3205427a5849 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:34.639535 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-f89b74d1-7640-4c2b-b292-c728000da435 req-91cb7e4f-fc94-407a-a07a-3205427a5849 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:34.640414 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-f89b74d1-7640-4c2b-b292-c728000da435 req-91cb7e4f-fc94-407a-a07a-3205427a5849 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:34.685649 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-f89b74d1-7640-4c2b-b292-c728000da435 req-91cb7e4f-fc94-407a-a07a-3205427a5849 service nova] Creating event network-changed:a616ea50-2a64-424a-bca9-fc3358e11f91 for instance 47d13255-9c47-4bba-a83c-1bba0adb6276 on hv-cinder-85391 Sep 02 05:33:34.705656 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-f89b74d1-7640-4c2b-b292-c728000da435 req-91cb7e4f-fc94-407a-a07a-3205427a5849 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094757 Sep 02 05:33:34.710704 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 575/1148] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 05:33:35.432385 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-1dd8c6b3-7518-4744-a70c-6283d4fb1b2e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:35.433876 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-1dd8c6b3-7518-4744-a70c-6283d4fb1b2e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:35.446067 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1dd8c6b3-7518-4744-a70c-6283d4fb1b2e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:35.447067 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1dd8c6b3-7518-4744-a70c-6283d4fb1b2e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:35.448826 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1dd8c6b3-7518-4744-a70c-6283d4fb1b2e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:35.449794 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1dd8c6b3-7518-4744-a70c-6283d4fb1b2e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:35.452798 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1dd8c6b3-7518-4744-a70c-6283d4fb1b2e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:35.453535 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1dd8c6b3-7518-4744-a70c-6283d4fb1b2e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:35.764784 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1dd8c6b3-7518-4744-a70c-6283d4fb1b2e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:35.784936 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1dd8c6b3-7518-4744-a70c-6283d4fb1b2e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:35.789935 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1dd8c6b3-7518-4744-a70c-6283d4fb1b2e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:35.798601 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-1dd8c6b3-7518-4744-a70c-6283d4fb1b2e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1738 microversion: 2.20 time: 0.370876 Sep 02 05:33:35.824885 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 576/1149] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:35 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1738 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:33:36.829547 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5e7e4edb-8700-4573-ab6d-62e7ebb94714 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:36.830246 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5e7e4edb-8700-4573-ab6d-62e7ebb94714 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:36.847226 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5e7e4edb-8700-4573-ab6d-62e7ebb94714 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:36.853154 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5e7e4edb-8700-4573-ab6d-62e7ebb94714 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:36.855378 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5e7e4edb-8700-4573-ab6d-62e7ebb94714 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:36.860202 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5e7e4edb-8700-4573-ab6d-62e7ebb94714 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:36.863138 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5e7e4edb-8700-4573-ab6d-62e7ebb94714 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:36.863757 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5e7e4edb-8700-4573-ab6d-62e7ebb94714 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:37.091767 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5e7e4edb-8700-4573-ab6d-62e7ebb94714 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:37.105016 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5e7e4edb-8700-4573-ab6d-62e7ebb94714 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:37.106846 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5e7e4edb-8700-4573-ab6d-62e7ebb94714 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:37.108346 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5e7e4edb-8700-4573-ab6d-62e7ebb94714 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1738 microversion: 2.20 time: 0.283162 Sep 02 05:33:37.109549 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 577/1150] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:36 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1738 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:33:38.135262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-213cf0fd-de51-4d9c-ada5-5b25701d2068 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:38.135960 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-213cf0fd-de51-4d9c-ada5-5b25701d2068 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:38.139386 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell0:SELECT=4 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:33:38.156313 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-213cf0fd-de51-4d9c-ada5-5b25701d2068 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:38.156865 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-213cf0fd-de51-4d9c-ada5-5b25701d2068 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:38.157994 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-213cf0fd-de51-4d9c-ada5-5b25701d2068 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:38.159264 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-213cf0fd-de51-4d9c-ada5-5b25701d2068 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:38.159887 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-213cf0fd-de51-4d9c-ada5-5b25701d2068 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:38.160559 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-213cf0fd-de51-4d9c-ada5-5b25701d2068 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:38.351156 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-213cf0fd-de51-4d9c-ada5-5b25701d2068 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:38.355505 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=100 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:33:38.364309 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-213cf0fd-de51-4d9c-ada5-5b25701d2068 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:38.366324 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-213cf0fd-de51-4d9c-ada5-5b25701d2068 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:38.367733 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-213cf0fd-de51-4d9c-ada5-5b25701d2068 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1738 microversion: 2.20 time: 0.236499 Sep 02 05:33:38.368908 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 578/1151] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:38 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:33:38.759898 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.network.neutron [None req-4301d20a-2d20-4634-a99d-15fe38affa03 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] validate_networks() for [('239438af-7bb7-4d71-98ef-7302bb97e27b', None, None, None, None, None)] {{(pid=120448) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 05:33:39.178101 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-4301d20a-2d20-4634-a99d-15fe38affa03 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Flavor limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 05:33:39.178602 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-4301d20a-2d20-4634-a99d-15fe38affa03 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Image limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 05:33:39.179170 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-4301d20a-2d20-4634-a99d-15fe38affa03 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Flavor pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 05:33:39.179626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-4301d20a-2d20-4634-a99d-15fe38affa03 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Image pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 05:33:39.180128 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-4301d20a-2d20-4634-a99d-15fe38affa03 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 05:33:39.191775 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4301d20a-2d20-4634-a99d-15fe38affa03 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:39.192771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4301d20a-2d20-4634-a99d-15fe38affa03 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:39.193455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4301d20a-2d20-4634-a99d-15fe38affa03 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:39.194400 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4301d20a-2d20-4634-a99d-15fe38affa03 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:39.194959 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4301d20a-2d20-4634-a99d-15fe38affa03 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:39.195476 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4301d20a-2d20-4634-a99d-15fe38affa03 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:39.216617 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-4301d20a-2d20-4634-a99d-15fe38affa03 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Getting quotas for project 88b420db5aef422b9ea85708c2d8e108. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:33:39.221211 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-4301d20a-2d20-4634-a99d-15fe38affa03 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Getting quotas for user bdba1dc4a5e9482cb4eb94d914c108bf and project 88b420db5aef422b9ea85708c2d8e108. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:33:39.232980 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-4301d20a-2d20-4634-a99d-15fe38affa03 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Going to run 1 instances... {{(pid=120448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 05:33:39.235952 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-4301d20a-2d20-4634-a99d-15fe38affa03 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3669111-2e3f-4f39-878f-19d263505eaa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 05:33:39.293423 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-4301d20a-2d20-4634-a99d-15fe38affa03 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 8.392992 Sep 02 05:33:39.294166 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 574/1152] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Sep 2 05:33:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 8395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 05:33:39.308201 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5873da31-ab12-49a8-b950-38ca9c1f1255 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:39.309154 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5873da31-ab12-49a8-b950-38ca9c1f1255 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:39.383096 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5873da31-ab12-49a8-b950-38ca9c1f1255 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:39.390550 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5873da31-ab12-49a8-b950-38ca9c1f1255 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1237 microversion: 2.1 time: 0.089372 Sep 02 05:33:39.391920 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-91222566-a993-4c16-b771-f8246bea1aab tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:39.396163 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-91222566-a993-4c16-b771-f8246bea1aab tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:39.405118 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-91222566-a993-4c16-b771-f8246bea1aab tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:39.405335 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 579/1153] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:39 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1237 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:39.406964 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-91222566-a993-4c16-b771-f8246bea1aab tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:39.407425 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-91222566-a993-4c16-b771-f8246bea1aab tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:39.408211 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-91222566-a993-4c16-b771-f8246bea1aab tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:39.408672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-91222566-a993-4c16-b771-f8246bea1aab tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:39.409092 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-91222566-a993-4c16-b771-f8246bea1aab tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:39.584801 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-91222566-a993-4c16-b771-f8246bea1aab tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:39.588156 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=100 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:33:39.602232 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-91222566-a993-4c16-b771-f8246bea1aab tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:39.605438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-91222566-a993-4c16-b771-f8246bea1aab tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:39.606692 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-91222566-a993-4c16-b771-f8246bea1aab tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1738 microversion: 2.20 time: 0.219324 Sep 02 05:33:39.621120 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 575/1154] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:39 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1738 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:40.412802 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-acb153a4-2e7d-4399-9256-9a80dda2ba17 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:40.414131 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-acb153a4-2e7d-4399-9256-9a80dda2ba17 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:40.425331 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-acb153a4-2e7d-4399-9256-9a80dda2ba17 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:40.426215 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-acb153a4-2e7d-4399-9256-9a80dda2ba17 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:40.426940 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-acb153a4-2e7d-4399-9256-9a80dda2ba17 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:40.428004 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-acb153a4-2e7d-4399-9256-9a80dda2ba17 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:40.428704 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-acb153a4-2e7d-4399-9256-9a80dda2ba17 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:40.429352 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-acb153a4-2e7d-4399-9256-9a80dda2ba17 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:40.496274 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-acb153a4-2e7d-4399-9256-9a80dda2ba17 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:40.504938 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-acb153a4-2e7d-4399-9256-9a80dda2ba17 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1289 microversion: 2.1 time: 0.095865 Sep 02 05:33:40.505527 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 580/1155] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:40 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1289 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:40.631650 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-52415356-b5db-4a7c-8651-daf97d25a967 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:40.632289 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-52415356-b5db-4a7c-8651-daf97d25a967 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:40.639525 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-52415356-b5db-4a7c-8651-daf97d25a967 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:40.640033 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-52415356-b5db-4a7c-8651-daf97d25a967 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:40.640529 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-52415356-b5db-4a7c-8651-daf97d25a967 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:40.641408 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-52415356-b5db-4a7c-8651-daf97d25a967 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:40.641867 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-52415356-b5db-4a7c-8651-daf97d25a967 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:40.642296 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-52415356-b5db-4a7c-8651-daf97d25a967 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:40.848335 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-52415356-b5db-4a7c-8651-daf97d25a967 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:40.859199 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-52415356-b5db-4a7c-8651-daf97d25a967 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:40.868216 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-52415356-b5db-4a7c-8651-daf97d25a967 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:40.869530 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-52415356-b5db-4a7c-8651-daf97d25a967 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1720 microversion: 2.20 time: 0.242273 Sep 02 05:33:40.870146 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 576/1156] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:40 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1720 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:41.287806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-1b1b6568-99b8-4896-a117-fbfde4479fc9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Action: 'create', calling method: .version_select at 0x7fc90b4da5e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-942327511", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDqIXhmSJLaHXeToymChPpwPB89H3i8BVVX0ejIum56B7wgJbPWyVEV3vsCTRsRkZtKc19B37zOhDHftSiMclgUc8s9Cwkt4RFDQu1X+tqpOWUGdWK2IpXpKlSzgd3kEw=="}} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:33:41.303686 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.quota [None req-1b1b6568-99b8-4896-a117-fbfde4479fc9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Getting quotas for project 4f5094f4d0894667b1d725d84b220858. Resources: {'key_pairs'} {{(pid=120449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:33:41.307663 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.quota [None req-1b1b6568-99b8-4896-a117-fbfde4479fc9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Getting quotas for user 017b21a3715243ff90cc70b7e115a68c and project 4f5094f4d0894667b1d725d84b220858. Resources: {'key_pairs'} {{(pid=120449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:33:41.333537 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-1b1b6568-99b8-4896-a117-fbfde4479fc9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.049809 Sep 02 05:33:41.334147 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 581/1157] 10.222.0.30 () {60 vars in 1159 bytes} [Fri Sep 2 05:33:41 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 05:33:41.388189 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-3a19f84a-e0e0-4efa-99f0-52a1f8709d13 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-271066605", "imageRef": "a7baebda-1cf1-47ff-8c0e-4ea34899e699", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-942327511", "networks": [{"uuid": "4a253499-aca9-411a-82ca-f28971c84420"}]}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:33:41.440321 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.network.neutron [None req-3a19f84a-e0e0-4efa-99f0-52a1f8709d13 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] validate_networks() for [('4a253499-aca9-411a-82ca-f28971c84420', None, None, None, None, None)] {{(pid=120448) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 05:33:41.527255 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-b6b7198f-9d69-4362-a6fd-5b2e29228880 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:41.527862 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-b6b7198f-9d69-4362-a6fd-5b2e29228880 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:41.534535 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b6b7198f-9d69-4362-a6fd-5b2e29228880 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:41.535011 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b6b7198f-9d69-4362-a6fd-5b2e29228880 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:41.535441 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b6b7198f-9d69-4362-a6fd-5b2e29228880 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:41.536146 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b6b7198f-9d69-4362-a6fd-5b2e29228880 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:41.536605 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b6b7198f-9d69-4362-a6fd-5b2e29228880 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:41.537023 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b6b7198f-9d69-4362-a6fd-5b2e29228880 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:41.612503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-b6b7198f-9d69-4362-a6fd-5b2e29228880 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:41.620634 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-b6b7198f-9d69-4362-a6fd-5b2e29228880 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1297 microversion: 2.1 time: 0.097435 Sep 02 05:33:41.621203 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 582/1158] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:41 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1297 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:41.844238 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-3a19f84a-e0e0-4efa-99f0-52a1f8709d13 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Flavor limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 05:33:41.844730 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-3a19f84a-e0e0-4efa-99f0-52a1f8709d13 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Image limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 05:33:41.845111 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-3a19f84a-e0e0-4efa-99f0-52a1f8709d13 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Flavor pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 05:33:41.845543 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-3a19f84a-e0e0-4efa-99f0-52a1f8709d13 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Image pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 05:33:41.845949 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-3a19f84a-e0e0-4efa-99f0-52a1f8709d13 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 05:33:41.855325 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3a19f84a-e0e0-4efa-99f0-52a1f8709d13 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:41.855821 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3a19f84a-e0e0-4efa-99f0-52a1f8709d13 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:41.856280 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3a19f84a-e0e0-4efa-99f0-52a1f8709d13 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:41.856994 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3a19f84a-e0e0-4efa-99f0-52a1f8709d13 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:41.857439 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3a19f84a-e0e0-4efa-99f0-52a1f8709d13 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:41.857899 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3a19f84a-e0e0-4efa-99f0-52a1f8709d13 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:41.875111 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-3a19f84a-e0e0-4efa-99f0-52a1f8709d13 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Getting quotas for project 4f5094f4d0894667b1d725d84b220858. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:33:41.878971 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-3a19f84a-e0e0-4efa-99f0-52a1f8709d13 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Getting quotas for user 017b21a3715243ff90cc70b7e115a68c and project 4f5094f4d0894667b1d725d84b220858. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:33:41.890882 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-3a19f84a-e0e0-4efa-99f0-52a1f8709d13 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Going to run 1 instances... {{(pid=120448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 05:33:41.893000 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-3a19f84a-e0e0-4efa-99f0-52a1f8709d13 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a7baebda-1cf1-47ff-8c0e-4ea34899e699',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 05:33:41.893429 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-1cb62c0a-b0e2-48ec-ac61-cfffa9268556 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:41.894221 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-1cb62c0a-b0e2-48ec-ac61-cfffa9268556 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:41.900464 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1cb62c0a-b0e2-48ec-ac61-cfffa9268556 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:41.900954 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1cb62c0a-b0e2-48ec-ac61-cfffa9268556 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:41.901386 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1cb62c0a-b0e2-48ec-ac61-cfffa9268556 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:41.902075 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1cb62c0a-b0e2-48ec-ac61-cfffa9268556 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:41.902522 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1cb62c0a-b0e2-48ec-ac61-cfffa9268556 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:41.902940 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1cb62c0a-b0e2-48ec-ac61-cfffa9268556 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:41.941441 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-3a19f84a-e0e0-4efa-99f0-52a1f8709d13 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557127 Sep 02 05:33:41.942718 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 577/1159] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Sep 2 05:33:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 05:33:41.953870 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-1ee3e9ab-b009-4659-9b1f-b54e429e9310 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:41.954404 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-1ee3e9ab-b009-4659-9b1f-b54e429e9310 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:42.021790 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-1ee3e9ab-b009-4659-9b1f-b54e429e9310 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:42.029941 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-1ee3e9ab-b009-4659-9b1f-b54e429e9310 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1257 microversion: 2.1 time: 0.080300 Sep 02 05:33:42.039088 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 578/1160] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:41 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1257 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:42.070729 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1cb62c0a-b0e2-48ec-ac61-cfffa9268556 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:42.079230 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1cb62c0a-b0e2-48ec-ac61-cfffa9268556 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:42.080747 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1cb62c0a-b0e2-48ec-ac61-cfffa9268556 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:42.081920 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-1cb62c0a-b0e2-48ec-ac61-cfffa9268556 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1720 microversion: 2.20 time: 0.192726 Sep 02 05:33:42.082483 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 583/1161] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:41 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1720 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:42.642094 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-cdb80729-bc86-45e3-bad3-4bc7d7829b10 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:42.642754 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-cdb80729-bc86-45e3-bad3-4bc7d7829b10 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:42.650414 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cdb80729-bc86-45e3-bad3-4bc7d7829b10 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:42.650994 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cdb80729-bc86-45e3-bad3-4bc7d7829b10 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:42.651601 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cdb80729-bc86-45e3-bad3-4bc7d7829b10 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:42.652505 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cdb80729-bc86-45e3-bad3-4bc7d7829b10 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:42.653106 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cdb80729-bc86-45e3-bad3-4bc7d7829b10 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:42.653788 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cdb80729-bc86-45e3-bad3-4bc7d7829b10 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:42.741465 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-ccc2f61b-f048-4973-a474-b2fd19b24ad1 req-7b1e9c5b-1ead-43cb-bcc6-da9b316c1000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d862d87f-85bc-4970-97b5-af0ff1b6ebf8", "name": "network-vif-unplugged", "status": "completed", "tag": "47f28e65-04e5-4573-84d6-9faa45a85dd1"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:33:42.755013 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-ccc2f61b-f048-4973-a474-b2fd19b24ad1 req-7b1e9c5b-1ead-43cb-bcc6-da9b316c1000 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:42.755696 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-ccc2f61b-f048-4973-a474-b2fd19b24ad1 req-7b1e9c5b-1ead-43cb-bcc6-da9b316c1000 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:42.756317 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-ccc2f61b-f048-4973-a474-b2fd19b24ad1 req-7b1e9c5b-1ead-43cb-bcc6-da9b316c1000 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:42.757554 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-cdb80729-bc86-45e3-bad3-4bc7d7829b10 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:42.767339 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-cdb80729-bc86-45e3-bad3-4bc7d7829b10 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1295 microversion: 2.1 time: 0.129373 Sep 02 05:33:42.770843 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-ccc2f61b-f048-4973-a474-b2fd19b24ad1 req-7b1e9c5b-1ead-43cb-bcc6-da9b316c1000 service nova] Creating event network-vif-unplugged:47f28e65-04e5-4573-84d6-9faa45a85dd1 for instance d862d87f-85bc-4970-97b5-af0ff1b6ebf8 on hv-cinder-85391 Sep 02 05:33:42.784381 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 579/1162] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:42 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1295 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:42.790708 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-ccc2f61b-f048-4973-a474-b2fd19b24ad1 req-7b1e9c5b-1ead-43cb-bcc6-da9b316c1000 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055984 Sep 02 05:33:42.792347 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 584/1163] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:33:43.052238 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-de0550d9-98b9-46f9-880a-5ff4176458c3 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:43.052900 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-de0550d9-98b9-46f9-880a-5ff4176458c3 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:43.059150 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-de0550d9-98b9-46f9-880a-5ff4176458c3 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:43.059955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-de0550d9-98b9-46f9-880a-5ff4176458c3 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:43.061688 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-de0550d9-98b9-46f9-880a-5ff4176458c3 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:43.062940 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-de0550d9-98b9-46f9-880a-5ff4176458c3 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:43.063612 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-de0550d9-98b9-46f9-880a-5ff4176458c3 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:43.064225 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-de0550d9-98b9-46f9-880a-5ff4176458c3 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:43.105405 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-2b374bba-6782-4a03-9138-fd2e443caa85 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:43.106130 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-2b374bba-6782-4a03-9138-fd2e443caa85 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:43.113160 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2b374bba-6782-4a03-9138-fd2e443caa85 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:43.113646 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2b374bba-6782-4a03-9138-fd2e443caa85 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:43.114075 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2b374bba-6782-4a03-9138-fd2e443caa85 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:43.115056 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2b374bba-6782-4a03-9138-fd2e443caa85 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:43.115503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2b374bba-6782-4a03-9138-fd2e443caa85 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:43.116083 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2b374bba-6782-4a03-9138-fd2e443caa85 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:43.149623 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-de0550d9-98b9-46f9-880a-5ff4176458c3 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:43.163786 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-de0550d9-98b9-46f9-880a-5ff4176458c3 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1309 microversion: 2.1 time: 0.116266 Sep 02 05:33:43.164591 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 580/1164] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:43 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1309 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:43.284041 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-2b374bba-6782-4a03-9138-fd2e443caa85 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:43.293069 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-2b374bba-6782-4a03-9138-fd2e443caa85 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:43.294521 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-2b374bba-6782-4a03-9138-fd2e443caa85 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:43.295820 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-2b374bba-6782-4a03-9138-fd2e443caa85 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1723 microversion: 2.20 time: 0.194689 Sep 02 05:33:43.296541 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 585/1165] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:43 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:33:43.318698 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-18ff8dc8-6b8e-41ce-8818-8ddce88e0936 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d7fa3e3-8f04-4303-bf9b-463197cd590e"}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:33:43.321304 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-18ff8dc8-6b8e-41ce-8818-8ddce88e0936 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:43.327437 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-18ff8dc8-6b8e-41ce-8818-8ddce88e0936 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:43.327915 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-18ff8dc8-6b8e-41ce-8818-8ddce88e0936 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:43.328379 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-18ff8dc8-6b8e-41ce-8818-8ddce88e0936 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:43.329081 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-18ff8dc8-6b8e-41ce-8818-8ddce88e0936 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:43.329528 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-18ff8dc8-6b8e-41ce-8818-8ddce88e0936 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:43.329956 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-18ff8dc8-6b8e-41ce-8818-8ddce88e0936 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:43.636895 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-18ff8dc8-6b8e-41ce-8818-8ddce88e0936 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "POST /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.321510 Sep 02 05:33:43.638041 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 581/1166] 10.222.0.30 () {62 vars in 1364 bytes} [Fri Sep 2 05:33:43 2022] POST /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8/os-volume_attachments => generated 188 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 05:33:43.792154 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-7ee091d0-4940-4fc0-9fe1-20bb5914f155 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:43.792154 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-7ee091d0-4940-4fc0-9fe1-20bb5914f155 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:43.795564 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-52c3ee50-e269-4e85-9e37-a0e15c9dadd9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:43.796960 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-52c3ee50-e269-4e85-9e37-a0e15c9dadd9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:43.825527 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-52c3ee50-e269-4e85-9e37-a0e15c9dadd9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:43.826051 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-52c3ee50-e269-4e85-9e37-a0e15c9dadd9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:43.826494 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-52c3ee50-e269-4e85-9e37-a0e15c9dadd9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:43.827065 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7ee091d0-4940-4fc0-9fe1-20bb5914f155 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:43.827273 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-52c3ee50-e269-4e85-9e37-a0e15c9dadd9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:43.827730 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-52c3ee50-e269-4e85-9e37-a0e15c9dadd9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:43.828075 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7ee091d0-4940-4fc0-9fe1-20bb5914f155 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:43.828690 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7ee091d0-4940-4fc0-9fe1-20bb5914f155 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:43.829605 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7ee091d0-4940-4fc0-9fe1-20bb5914f155 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:43.830284 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7ee091d0-4940-4fc0-9fe1-20bb5914f155 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:43.834313 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7ee091d0-4940-4fc0-9fe1-20bb5914f155 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:43.836306 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-52c3ee50-e269-4e85-9e37-a0e15c9dadd9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:44.134173 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-7ee091d0-4940-4fc0-9fe1-20bb5914f155 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:44.165732 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-7ee091d0-4940-4fc0-9fe1-20bb5914f155 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.371198 Sep 02 05:33:44.168748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 582/1167] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:43 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:33:44.189266 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f3ed409c-b805-464c-9fdf-a74e4a4c2827 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:44.196260 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f3ed409c-b805-464c-9fdf-a74e4a4c2827 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:44.211527 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f3ed409c-b805-464c-9fdf-a74e4a4c2827 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:44.213024 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f3ed409c-b805-464c-9fdf-a74e4a4c2827 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:44.213659 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f3ed409c-b805-464c-9fdf-a74e4a4c2827 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:44.216954 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f3ed409c-b805-464c-9fdf-a74e4a4c2827 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:44.217623 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f3ed409c-b805-464c-9fdf-a74e4a4c2827 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:44.218234 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f3ed409c-b805-464c-9fdf-a74e4a4c2827 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:44.287617 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-52c3ee50-e269-4e85-9e37-a0e15c9dadd9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8/os-volume_attachments/6d7fa3e3-8f04-4303-bf9b-463197cd590e" status: 202 len: 0 microversion: 2.20 time: 0.503181 Sep 02 05:33:44.288823 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 586/1168] 10.222.0.30 () {60 vars in 1457 bytes} [Fri Sep 2 05:33:43 2022] DELETE /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8/os-volume_attachments/6d7fa3e3-8f04-4303-bf9b-463197cd590e => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 05:33:44.364757 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-04bf5da0-1eb8-4199-b16c-f785f777a238 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:33:44.365637 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-04bf5da0-1eb8-4199-b16c-f785f777a238 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:44.372148 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-04bf5da0-1eb8-4199-b16c-f785f777a238 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:44.372790 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-04bf5da0-1eb8-4199-b16c-f785f777a238 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:44.373368 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-04bf5da0-1eb8-4199-b16c-f785f777a238 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:44.374273 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-04bf5da0-1eb8-4199-b16c-f785f777a238 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:44.374871 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-04bf5da0-1eb8-4199-b16c-f785f777a238 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:44.375450 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-04bf5da0-1eb8-4199-b16c-f785f777a238 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:44.406314 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f3ed409c-b805-464c-9fdf-a74e4a4c2827 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:44.417014 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f3ed409c-b805-464c-9fdf-a74e4a4c2827 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1315 microversion: 2.1 time: 0.232449 Sep 02 05:33:44.417590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 583/1169] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:44 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:44.462600 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-5feed4d5-277f-42d3-bc05-3acab15d5fc0 req-fd5917d2-3514-40e8-bccc-7d98c21b00fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d19306c3-935d-4876-9adb-651da56d0574", "tag": "e83b7424-9d82-42cb-813a-c872cb5208ac"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:33:44.490919 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-5feed4d5-277f-42d3-bc05-3acab15d5fc0 req-fd5917d2-3514-40e8-bccc-7d98c21b00fe service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:44.493345 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-5feed4d5-277f-42d3-bc05-3acab15d5fc0 req-fd5917d2-3514-40e8-bccc-7d98c21b00fe service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:44.494395 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-5feed4d5-277f-42d3-bc05-3acab15d5fc0 req-fd5917d2-3514-40e8-bccc-7d98c21b00fe service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:44.526443 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-5feed4d5-277f-42d3-bc05-3acab15d5fc0 req-fd5917d2-3514-40e8-bccc-7d98c21b00fe service nova] Creating event network-changed:e83b7424-9d82-42cb-813a-c872cb5208ac for instance d19306c3-935d-4876-9adb-651da56d0574 on hv-cinder-85391 Sep 02 05:33:44.537110 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-5feed4d5-277f-42d3-bc05-3acab15d5fc0 req-fd5917d2-3514-40e8-bccc-7d98c21b00fe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089366 Sep 02 05:33:44.540645 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 584/1170] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:33:44.620044 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-04bf5da0-1eb8-4199-b16c-f785f777a238 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120449) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 02 05:33:44.791868 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-04bf5da0-1eb8-4199-b16c-f785f777a238 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "POST /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8/action" status: 202 len: 0 microversion: 2.20 time: 0.431673 Sep 02 05:33:44.793445 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 587/1171] 10.222.0.30 () {62 vars in 1319 bytes} [Fri Sep 2 05:33:44 2022] POST /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 02 05:33:44.803199 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-c12ffb57-bbe8-4a35-960d-41056e5f7cc5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:44.804094 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-c12ffb57-bbe8-4a35-960d-41056e5f7cc5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:44.815135 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c12ffb57-bbe8-4a35-960d-41056e5f7cc5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:44.820626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c12ffb57-bbe8-4a35-960d-41056e5f7cc5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:44.821379 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c12ffb57-bbe8-4a35-960d-41056e5f7cc5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:44.822340 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c12ffb57-bbe8-4a35-960d-41056e5f7cc5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:44.823014 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c12ffb57-bbe8-4a35-960d-41056e5f7cc5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:44.823720 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c12ffb57-bbe8-4a35-960d-41056e5f7cc5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:45.181721 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c12ffb57-bbe8-4a35-960d-41056e5f7cc5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:45.191469 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c12ffb57-bbe8-4a35-960d-41056e5f7cc5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:45.191758 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-4d88b560-2ffe-40cf-ac20-f06a6cec4a55 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:45.192529 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-4d88b560-2ffe-40cf-ac20-f06a6cec4a55 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:45.194042 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c12ffb57-bbe8-4a35-960d-41056e5f7cc5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:45.195524 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-c12ffb57-bbe8-4a35-960d-41056e5f7cc5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1671 microversion: 2.20 time: 0.397924 Sep 02 05:33:45.196639 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 585/1172] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:44 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1671 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:45.208542 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4d88b560-2ffe-40cf-ac20-f06a6cec4a55 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:45.209289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4d88b560-2ffe-40cf-ac20-f06a6cec4a55 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:45.210018 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4d88b560-2ffe-40cf-ac20-f06a6cec4a55 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:45.222623 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4d88b560-2ffe-40cf-ac20-f06a6cec4a55 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:45.223127 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4d88b560-2ffe-40cf-ac20-f06a6cec4a55 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:45.223574 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4d88b560-2ffe-40cf-ac20-f06a6cec4a55 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:45.432865 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-4d88b560-2ffe-40cf-ac20-f06a6cec4a55 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:45.440260 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-dfafb829-add3-4bf2-8799-12a27e9ce706 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:45.441229 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-4d88b560-2ffe-40cf-ac20-f06a6cec4a55 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.254230 Sep 02 05:33:45.441707 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-dfafb829-add3-4bf2-8799-12a27e9ce706 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:45.454966 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 588/1173] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:45 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:45.469942 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dfafb829-add3-4bf2-8799-12a27e9ce706 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:45.470654 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dfafb829-add3-4bf2-8799-12a27e9ce706 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:45.471248 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dfafb829-add3-4bf2-8799-12a27e9ce706 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:45.472513 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dfafb829-add3-4bf2-8799-12a27e9ce706 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:45.473151 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dfafb829-add3-4bf2-8799-12a27e9ce706 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:45.473584 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dfafb829-add3-4bf2-8799-12a27e9ce706 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:45.654364 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-dfafb829-add3-4bf2-8799-12a27e9ce706 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:45.664395 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-dfafb829-add3-4bf2-8799-12a27e9ce706 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.229807 Sep 02 05:33:45.665287 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 586/1174] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:45 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:33:46.219339 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5808d8d9-35d8-4aec-8feb-f076b30deff0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:46.220077 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5808d8d9-35d8-4aec-8feb-f076b30deff0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:46.227831 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5808d8d9-35d8-4aec-8feb-f076b30deff0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:46.228357 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5808d8d9-35d8-4aec-8feb-f076b30deff0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:46.228794 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5808d8d9-35d8-4aec-8feb-f076b30deff0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:46.229686 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5808d8d9-35d8-4aec-8feb-f076b30deff0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:46.230149 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5808d8d9-35d8-4aec-8feb-f076b30deff0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:46.230578 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5808d8d9-35d8-4aec-8feb-f076b30deff0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:46.370163 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5808d8d9-35d8-4aec-8feb-f076b30deff0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:46.379545 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5808d8d9-35d8-4aec-8feb-f076b30deff0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:46.381449 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5808d8d9-35d8-4aec-8feb-f076b30deff0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:46.383037 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5808d8d9-35d8-4aec-8feb-f076b30deff0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1671 microversion: 2.20 time: 0.167693 Sep 02 05:33:46.397532 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 589/1175] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:46 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1671 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:46.462299 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d5711d39-9ebc-487f-96ce-7cb62e5f04e5 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:46.462906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-d5711d39-9ebc-487f-96ce-7cb62e5f04e5 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:46.469965 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d5711d39-9ebc-487f-96ce-7cb62e5f04e5 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:46.470379 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d5711d39-9ebc-487f-96ce-7cb62e5f04e5 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:46.470805 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d5711d39-9ebc-487f-96ce-7cb62e5f04e5 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:46.471479 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d5711d39-9ebc-487f-96ce-7cb62e5f04e5 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:46.471929 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d5711d39-9ebc-487f-96ce-7cb62e5f04e5 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:46.473663 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d5711d39-9ebc-487f-96ce-7cb62e5f04e5 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:46.614093 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d5711d39-9ebc-487f-96ce-7cb62e5f04e5 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:46.622313 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-d5711d39-9ebc-487f-96ce-7cb62e5f04e5 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.163839 Sep 02 05:33:46.636681 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 587/1176] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:46 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:46.685322 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-a4fc9218-8ccb-49be-ad7d-70457b8ebe83 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:46.685937 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-a4fc9218-8ccb-49be-ad7d-70457b8ebe83 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:46.692191 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a4fc9218-8ccb-49be-ad7d-70457b8ebe83 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:46.692801 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a4fc9218-8ccb-49be-ad7d-70457b8ebe83 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:46.693361 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a4fc9218-8ccb-49be-ad7d-70457b8ebe83 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:46.694171 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a4fc9218-8ccb-49be-ad7d-70457b8ebe83 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:46.696185 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a4fc9218-8ccb-49be-ad7d-70457b8ebe83 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:46.696185 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a4fc9218-8ccb-49be-ad7d-70457b8ebe83 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:46.838754 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-a4fc9218-8ccb-49be-ad7d-70457b8ebe83 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:46.846898 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-a4fc9218-8ccb-49be-ad7d-70457b8ebe83 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.165369 Sep 02 05:33:46.847475 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 590/1177] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:46 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:47.406741 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-0d3614c6-5c22-4cbc-801f-092815a2fbad tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:47.407344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-0d3614c6-5c22-4cbc-801f-092815a2fbad tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:47.413457 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0d3614c6-5c22-4cbc-801f-092815a2fbad tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:47.413941 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0d3614c6-5c22-4cbc-801f-092815a2fbad tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:47.414369 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0d3614c6-5c22-4cbc-801f-092815a2fbad tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:47.415069 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0d3614c6-5c22-4cbc-801f-092815a2fbad tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:47.415511 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0d3614c6-5c22-4cbc-801f-092815a2fbad tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:47.415948 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0d3614c6-5c22-4cbc-801f-092815a2fbad tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:47.556731 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-0d3614c6-5c22-4cbc-801f-092815a2fbad tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:47.565555 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-0d3614c6-5c22-4cbc-801f-092815a2fbad tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:47.567001 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-0d3614c6-5c22-4cbc-801f-092815a2fbad tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:47.568225 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-0d3614c6-5c22-4cbc-801f-092815a2fbad tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1671 microversion: 2.20 time: 0.165626 Sep 02 05:33:47.569001 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 588/1178] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:47 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1671 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:47.644097 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ae9ac70f-22f9-4f8f-8a0f-ffc20c1b5251 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:47.645115 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-ae9ac70f-22f9-4f8f-8a0f-ffc20c1b5251 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:47.656001 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ae9ac70f-22f9-4f8f-8a0f-ffc20c1b5251 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:47.656526 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ae9ac70f-22f9-4f8f-8a0f-ffc20c1b5251 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:47.657016 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ae9ac70f-22f9-4f8f-8a0f-ffc20c1b5251 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:47.657689 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ae9ac70f-22f9-4f8f-8a0f-ffc20c1b5251 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:47.658148 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ae9ac70f-22f9-4f8f-8a0f-ffc20c1b5251 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:47.658577 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ae9ac70f-22f9-4f8f-8a0f-ffc20c1b5251 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:47.807050 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ae9ac70f-22f9-4f8f-8a0f-ffc20c1b5251 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:47.815109 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-ae9ac70f-22f9-4f8f-8a0f-ffc20c1b5251 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.174978 Sep 02 05:33:47.815684 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 591/1179] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:47 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:47.870304 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-3994b761-9403-4216-88df-39b139ac0ba1 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:47.871272 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-3994b761-9403-4216-88df-39b139ac0ba1 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:47.877688 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3994b761-9403-4216-88df-39b139ac0ba1 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:47.878183 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3994b761-9403-4216-88df-39b139ac0ba1 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:47.878618 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3994b761-9403-4216-88df-39b139ac0ba1 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:47.879333 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3994b761-9403-4216-88df-39b139ac0ba1 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:47.879793 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3994b761-9403-4216-88df-39b139ac0ba1 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:47.880273 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3994b761-9403-4216-88df-39b139ac0ba1 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:48.022743 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-3994b761-9403-4216-88df-39b139ac0ba1 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:48.030744 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-3994b761-9403-4216-88df-39b139ac0ba1 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.165041 Sep 02 05:33:48.031318 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 589/1180] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:47 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:48.591465 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-7f1b833c-160c-4138-be81-c5f80cc70e69 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:48.592081 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-7f1b833c-160c-4138-be81-c5f80cc70e69 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:48.598782 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7f1b833c-160c-4138-be81-c5f80cc70e69 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:48.599268 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7f1b833c-160c-4138-be81-c5f80cc70e69 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:48.599709 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7f1b833c-160c-4138-be81-c5f80cc70e69 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:48.600417 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7f1b833c-160c-4138-be81-c5f80cc70e69 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:48.600910 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7f1b833c-160c-4138-be81-c5f80cc70e69 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:48.601314 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7f1b833c-160c-4138-be81-c5f80cc70e69 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:48.751726 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-7f1b833c-160c-4138-be81-c5f80cc70e69 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:48.760725 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-7f1b833c-160c-4138-be81-c5f80cc70e69 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:48.762562 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-7f1b833c-160c-4138-be81-c5f80cc70e69 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:48.764166 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-7f1b833c-160c-4138-be81-c5f80cc70e69 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1671 microversion: 2.20 time: 0.176528 Sep 02 05:33:48.765154 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 592/1181] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:48 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1671 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:48.835331 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-4836e612-ef7a-4d0e-9cf8-f5ca6e96fea1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:48.835988 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-4836e612-ef7a-4d0e-9cf8-f5ca6e96fea1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:48.849455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4836e612-ef7a-4d0e-9cf8-f5ca6e96fea1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:48.850093 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4836e612-ef7a-4d0e-9cf8-f5ca6e96fea1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:48.851763 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4836e612-ef7a-4d0e-9cf8-f5ca6e96fea1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:48.855962 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4836e612-ef7a-4d0e-9cf8-f5ca6e96fea1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:48.856495 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4836e612-ef7a-4d0e-9cf8-f5ca6e96fea1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:48.856937 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4836e612-ef7a-4d0e-9cf8-f5ca6e96fea1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:49.006050 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-4836e612-ef7a-4d0e-9cf8-f5ca6e96fea1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:49.014382 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-4836e612-ef7a-4d0e-9cf8-f5ca6e96fea1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.182921 Sep 02 05:33:49.014971 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 590/1182] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:48 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:49.050931 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-dc2e9f31-f4ac-4db5-9114-849ab86d5e0f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:49.051540 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-dc2e9f31-f4ac-4db5-9114-849ab86d5e0f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:49.057914 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dc2e9f31-f4ac-4db5-9114-849ab86d5e0f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:49.058431 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dc2e9f31-f4ac-4db5-9114-849ab86d5e0f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:49.058872 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dc2e9f31-f4ac-4db5-9114-849ab86d5e0f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:49.059581 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dc2e9f31-f4ac-4db5-9114-849ab86d5e0f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:49.060071 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dc2e9f31-f4ac-4db5-9114-849ab86d5e0f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:49.060532 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dc2e9f31-f4ac-4db5-9114-849ab86d5e0f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:49.206665 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-dc2e9f31-f4ac-4db5-9114-849ab86d5e0f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:49.214676 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-dc2e9f31-f4ac-4db5-9114-849ab86d5e0f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.167695 Sep 02 05:33:49.215297 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 593/1183] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:49 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:49.787238 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-beeb3925-436f-48fb-9dc5-336cc3c84671 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:49.787843 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-beeb3925-436f-48fb-9dc5-336cc3c84671 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:49.793974 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-beeb3925-436f-48fb-9dc5-336cc3c84671 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:49.794456 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-beeb3925-436f-48fb-9dc5-336cc3c84671 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:49.794886 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-beeb3925-436f-48fb-9dc5-336cc3c84671 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:49.795570 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-beeb3925-436f-48fb-9dc5-336cc3c84671 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:49.796131 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-beeb3925-436f-48fb-9dc5-336cc3c84671 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:49.796936 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-beeb3925-436f-48fb-9dc5-336cc3c84671 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:49.933740 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-beeb3925-436f-48fb-9dc5-336cc3c84671 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:49.942527 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-beeb3925-436f-48fb-9dc5-336cc3c84671 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:49.943992 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-beeb3925-436f-48fb-9dc5-336cc3c84671 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:49.945222 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-beeb3925-436f-48fb-9dc5-336cc3c84671 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1671 microversion: 2.20 time: 0.161995 Sep 02 05:33:49.945768 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 591/1184] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:49 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:50.035995 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-a76ac389-8c15-4740-b6e5-033dbcf959d4 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:50.036676 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-a76ac389-8c15-4740-b6e5-033dbcf959d4 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:50.043640 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a76ac389-8c15-4740-b6e5-033dbcf959d4 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:50.044442 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a76ac389-8c15-4740-b6e5-033dbcf959d4 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:50.044885 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a76ac389-8c15-4740-b6e5-033dbcf959d4 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:50.045790 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a76ac389-8c15-4740-b6e5-033dbcf959d4 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:50.046268 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a76ac389-8c15-4740-b6e5-033dbcf959d4 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:50.046694 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a76ac389-8c15-4740-b6e5-033dbcf959d4 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:50.187996 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-a76ac389-8c15-4740-b6e5-033dbcf959d4 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:50.190831 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:33:50.199073 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-a76ac389-8c15-4740-b6e5-033dbcf959d4 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.167004 Sep 02 05:33:50.199791 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 594/1185] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:50 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:50.236869 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-cf2cac98-9644-492f-96f2-bf82ac877a55 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:50.237879 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-cf2cac98-9644-492f-96f2-bf82ac877a55 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:50.244297 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cf2cac98-9644-492f-96f2-bf82ac877a55 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:50.244927 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cf2cac98-9644-492f-96f2-bf82ac877a55 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:50.245270 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cf2cac98-9644-492f-96f2-bf82ac877a55 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:50.246007 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cf2cac98-9644-492f-96f2-bf82ac877a55 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:50.246456 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cf2cac98-9644-492f-96f2-bf82ac877a55 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:50.246911 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cf2cac98-9644-492f-96f2-bf82ac877a55 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:50.252736 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:33:50.387637 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-cf2cac98-9644-492f-96f2-bf82ac877a55 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:50.395721 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-cf2cac98-9644-492f-96f2-bf82ac877a55 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.163187 Sep 02 05:33:50.396357 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 592/1186] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:50 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:50.970605 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5a1428d0-f76a-4122-b399-d0279dc3d5ca tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:50.971125 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5a1428d0-f76a-4122-b399-d0279dc3d5ca tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:50.978542 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5a1428d0-f76a-4122-b399-d0279dc3d5ca tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:50.979127 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5a1428d0-f76a-4122-b399-d0279dc3d5ca tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:50.979575 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5a1428d0-f76a-4122-b399-d0279dc3d5ca tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:50.980356 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5a1428d0-f76a-4122-b399-d0279dc3d5ca tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:50.984201 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5a1428d0-f76a-4122-b399-d0279dc3d5ca tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:50.984915 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5a1428d0-f76a-4122-b399-d0279dc3d5ca tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:51.133676 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5a1428d0-f76a-4122-b399-d0279dc3d5ca tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:51.142320 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5a1428d0-f76a-4122-b399-d0279dc3d5ca tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:51.143767 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5a1428d0-f76a-4122-b399-d0279dc3d5ca tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:51.144994 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5a1428d0-f76a-4122-b399-d0279dc3d5ca tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1671 microversion: 2.20 time: 0.180053 Sep 02 05:33:51.145549 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 595/1187] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:50 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1671 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:51.221579 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-e831c5e0-1fb8-4077-9f20-295dd2b3fa5b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:51.222201 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-e831c5e0-1fb8-4077-9f20-295dd2b3fa5b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:51.228978 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e831c5e0-1fb8-4077-9f20-295dd2b3fa5b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:51.229462 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e831c5e0-1fb8-4077-9f20-295dd2b3fa5b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:51.229904 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e831c5e0-1fb8-4077-9f20-295dd2b3fa5b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:51.230613 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e831c5e0-1fb8-4077-9f20-295dd2b3fa5b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:51.231063 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e831c5e0-1fb8-4077-9f20-295dd2b3fa5b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:51.231483 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e831c5e0-1fb8-4077-9f20-295dd2b3fa5b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:51.372871 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-e831c5e0-1fb8-4077-9f20-295dd2b3fa5b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:51.389689 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-e831c5e0-1fb8-4077-9f20-295dd2b3fa5b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.170382 Sep 02 05:33:51.400755 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 593/1188] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:51 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:51.417836 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-95a91566-5f56-46ee-a549-b61d9e2f8a33 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:51.418460 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-95a91566-5f56-46ee-a549-b61d9e2f8a33 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:51.420501 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell0:SELECT=6 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:33:51.426191 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-95a91566-5f56-46ee-a549-b61d9e2f8a33 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:51.426688 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-95a91566-5f56-46ee-a549-b61d9e2f8a33 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:51.427127 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-95a91566-5f56-46ee-a549-b61d9e2f8a33 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:51.427829 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-95a91566-5f56-46ee-a549-b61d9e2f8a33 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:51.428311 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-95a91566-5f56-46ee-a549-b61d9e2f8a33 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:51.428737 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-95a91566-5f56-46ee-a549-b61d9e2f8a33 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:51.563490 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-95a91566-5f56-46ee-a549-b61d9e2f8a33 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:51.571579 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-95a91566-5f56-46ee-a549-b61d9e2f8a33 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.158031 Sep 02 05:33:51.572205 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 596/1189] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:51 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:52.169536 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d55c7408-2c67-451a-9164-a528e1232793 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:52.169886 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-d55c7408-2c67-451a-9164-a528e1232793 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:52.171824 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell0:SELECT=4 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:33:52.172820 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell0:SELECT=14 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:33:52.178666 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d55c7408-2c67-451a-9164-a528e1232793 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:52.179152 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d55c7408-2c67-451a-9164-a528e1232793 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:52.179565 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d55c7408-2c67-451a-9164-a528e1232793 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:52.180326 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d55c7408-2c67-451a-9164-a528e1232793 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:52.180798 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d55c7408-2c67-451a-9164-a528e1232793 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:52.181188 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d55c7408-2c67-451a-9164-a528e1232793 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:52.337559 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d55c7408-2c67-451a-9164-a528e1232793 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:52.350258 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d55c7408-2c67-451a-9164-a528e1232793 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:52.351858 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d55c7408-2c67-451a-9164-a528e1232793 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:52.353226 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-d55c7408-2c67-451a-9164-a528e1232793 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1671 microversion: 2.20 time: 0.188354 Sep 02 05:33:52.353990 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 594/1190] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:52 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1671 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:52.410354 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ffc83c7a-9ab0-4cec-b2bf-6f60b3a5175e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:52.411026 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-ffc83c7a-9ab0-4cec-b2bf-6f60b3a5175e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:52.417649 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ffc83c7a-9ab0-4cec-b2bf-6f60b3a5175e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:52.418101 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ffc83c7a-9ab0-4cec-b2bf-6f60b3a5175e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:52.418537 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ffc83c7a-9ab0-4cec-b2bf-6f60b3a5175e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:52.419274 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ffc83c7a-9ab0-4cec-b2bf-6f60b3a5175e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:52.419729 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ffc83c7a-9ab0-4cec-b2bf-6f60b3a5175e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:52.420210 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ffc83c7a-9ab0-4cec-b2bf-6f60b3a5175e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:52.570435 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ffc83c7a-9ab0-4cec-b2bf-6f60b3a5175e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:52.579500 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-ffc83c7a-9ab0-4cec-b2bf-6f60b3a5175e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.173101 Sep 02 05:33:52.580067 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 597/1191] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:52 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:52.596755 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-3950ecce-9786-4364-807f-9bee8b3cad00 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:52.597549 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-3950ecce-9786-4364-807f-9bee8b3cad00 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:52.605598 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3950ecce-9786-4364-807f-9bee8b3cad00 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:52.606179 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3950ecce-9786-4364-807f-9bee8b3cad00 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:52.606694 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3950ecce-9786-4364-807f-9bee8b3cad00 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:52.607492 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3950ecce-9786-4364-807f-9bee8b3cad00 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:52.608256 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3950ecce-9786-4364-807f-9bee8b3cad00 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:52.608847 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3950ecce-9786-4364-807f-9bee8b3cad00 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:52.747455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-3950ecce-9786-4364-807f-9bee8b3cad00 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:52.756224 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-3950ecce-9786-4364-807f-9bee8b3cad00 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.164284 Sep 02 05:33:52.757121 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 595/1192] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:52 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:53.376611 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-bc50b966-e562-4b71-a5eb-2f9986473fb8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:53.377270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-bc50b966-e562-4b71-a5eb-2f9986473fb8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:53.383708 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bc50b966-e562-4b71-a5eb-2f9986473fb8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:53.384222 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bc50b966-e562-4b71-a5eb-2f9986473fb8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:53.384655 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bc50b966-e562-4b71-a5eb-2f9986473fb8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:53.385384 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bc50b966-e562-4b71-a5eb-2f9986473fb8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:53.385854 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bc50b966-e562-4b71-a5eb-2f9986473fb8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:53.386281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bc50b966-e562-4b71-a5eb-2f9986473fb8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:53.532087 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-bc50b966-e562-4b71-a5eb-2f9986473fb8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:53.540354 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-bc50b966-e562-4b71-a5eb-2f9986473fb8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:53.541776 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-bc50b966-e562-4b71-a5eb-2f9986473fb8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:53.542941 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-bc50b966-e562-4b71-a5eb-2f9986473fb8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1671 microversion: 2.20 time: 0.170684 Sep 02 05:33:53.543502 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 598/1193] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:53 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1671 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:53.603817 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-79cff95b-3057-43b5-b084-ee5915ed991d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:53.604754 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-79cff95b-3057-43b5-b084-ee5915ed991d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:53.615714 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-79cff95b-3057-43b5-b084-ee5915ed991d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:53.616562 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-79cff95b-3057-43b5-b084-ee5915ed991d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:53.617281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-79cff95b-3057-43b5-b084-ee5915ed991d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:53.618399 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-79cff95b-3057-43b5-b084-ee5915ed991d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:53.619162 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-79cff95b-3057-43b5-b084-ee5915ed991d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:53.619851 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-79cff95b-3057-43b5-b084-ee5915ed991d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:53.754453 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-79cff95b-3057-43b5-b084-ee5915ed991d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:53.764392 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-79cff95b-3057-43b5-b084-ee5915ed991d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.167103 Sep 02 05:33:53.764963 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 596/1194] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:53 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:33:53.776926 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ec724308-e3d8-4f03-9620-370c61896a91 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:53.777535 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-ec724308-e3d8-4f03-9620-370c61896a91 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:53.783921 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ec724308-e3d8-4f03-9620-370c61896a91 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:53.784438 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ec724308-e3d8-4f03-9620-370c61896a91 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:53.784869 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ec724308-e3d8-4f03-9620-370c61896a91 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:53.785545 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ec724308-e3d8-4f03-9620-370c61896a91 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:53.786019 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ec724308-e3d8-4f03-9620-370c61896a91 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:53.786440 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ec724308-e3d8-4f03-9620-370c61896a91 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:53.921174 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ec724308-e3d8-4f03-9620-370c61896a91 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:53.929519 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-ec724308-e3d8-4f03-9620-370c61896a91 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.156466 Sep 02 05:33:53.930088 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 599/1195] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:53 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:54.571311 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-317ff20e-0b79-44bb-9492-3cc9d6747ad8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:54.572207 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-317ff20e-0b79-44bb-9492-3cc9d6747ad8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:54.580569 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-317ff20e-0b79-44bb-9492-3cc9d6747ad8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:54.581054 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-317ff20e-0b79-44bb-9492-3cc9d6747ad8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:54.581487 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-317ff20e-0b79-44bb-9492-3cc9d6747ad8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:54.582178 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-317ff20e-0b79-44bb-9492-3cc9d6747ad8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:54.582629 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-317ff20e-0b79-44bb-9492-3cc9d6747ad8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:54.583054 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-317ff20e-0b79-44bb-9492-3cc9d6747ad8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:54.712253 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-317ff20e-0b79-44bb-9492-3cc9d6747ad8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:54.723284 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-317ff20e-0b79-44bb-9492-3cc9d6747ad8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:54.724755 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-317ff20e-0b79-44bb-9492-3cc9d6747ad8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:54.725955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-317ff20e-0b79-44bb-9492-3cc9d6747ad8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1671 microversion: 2.20 time: 0.161754 Sep 02 05:33:54.726491 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 597/1196] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:54 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:54.787726 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-9cdeb0c6-3d9f-49ce-a113-07161fd1775a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:54.788334 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-9cdeb0c6-3d9f-49ce-a113-07161fd1775a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:54.797632 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9cdeb0c6-3d9f-49ce-a113-07161fd1775a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:54.798109 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9cdeb0c6-3d9f-49ce-a113-07161fd1775a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:54.798539 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9cdeb0c6-3d9f-49ce-a113-07161fd1775a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:54.799254 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9cdeb0c6-3d9f-49ce-a113-07161fd1775a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:54.799703 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9cdeb0c6-3d9f-49ce-a113-07161fd1775a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:54.800146 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9cdeb0c6-3d9f-49ce-a113-07161fd1775a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:54.933305 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-9cdeb0c6-3d9f-49ce-a113-07161fd1775a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:54.945253 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-9cdeb0c6-3d9f-49ce-a113-07161fd1775a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.161704 Sep 02 05:33:54.945854 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 600/1197] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:54 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:54.953237 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-b8a1d170-eb6b-4a11-86ae-2bb0337771f7 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:54.953850 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-b8a1d170-eb6b-4a11-86ae-2bb0337771f7 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:54.960133 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b8a1d170-eb6b-4a11-86ae-2bb0337771f7 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:54.960635 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b8a1d170-eb6b-4a11-86ae-2bb0337771f7 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:54.961067 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b8a1d170-eb6b-4a11-86ae-2bb0337771f7 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:54.961755 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b8a1d170-eb6b-4a11-86ae-2bb0337771f7 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:54.962204 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b8a1d170-eb6b-4a11-86ae-2bb0337771f7 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:54.962629 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b8a1d170-eb6b-4a11-86ae-2bb0337771f7 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:55.096239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-b8a1d170-eb6b-4a11-86ae-2bb0337771f7 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:55.104098 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-b8a1d170-eb6b-4a11-86ae-2bb0337771f7 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.156926 Sep 02 05:33:55.104691 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 598/1198] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:54 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:55.751429 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-a534b032-8e9d-47cf-b4d2-b7edb9c69152 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:55.752047 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-a534b032-8e9d-47cf-b4d2-b7edb9c69152 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:55.758445 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a534b032-8e9d-47cf-b4d2-b7edb9c69152 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:55.758922 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a534b032-8e9d-47cf-b4d2-b7edb9c69152 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:55.759351 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a534b032-8e9d-47cf-b4d2-b7edb9c69152 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:55.760034 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a534b032-8e9d-47cf-b4d2-b7edb9c69152 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:55.760525 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a534b032-8e9d-47cf-b4d2-b7edb9c69152 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:55.760968 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a534b032-8e9d-47cf-b4d2-b7edb9c69152 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:55.889509 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-a534b032-8e9d-47cf-b4d2-b7edb9c69152 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:55.902154 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-a534b032-8e9d-47cf-b4d2-b7edb9c69152 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:55.904507 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-a534b032-8e9d-47cf-b4d2-b7edb9c69152 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:55.906182 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-a534b032-8e9d-47cf-b4d2-b7edb9c69152 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1671 microversion: 2.20 time: 0.159858 Sep 02 05:33:55.906744 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 601/1199] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:55 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1671 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:55.969450 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-be201d81-1e46-4b6d-b822-eb8306f67e09 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:55.969987 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-be201d81-1e46-4b6d-b822-eb8306f67e09 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:55.972392 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:33:55.977924 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-be201d81-1e46-4b6d-b822-eb8306f67e09 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:55.978397 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-be201d81-1e46-4b6d-b822-eb8306f67e09 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:55.978827 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-be201d81-1e46-4b6d-b822-eb8306f67e09 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:55.979505 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-be201d81-1e46-4b6d-b822-eb8306f67e09 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:55.979955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-be201d81-1e46-4b6d-b822-eb8306f67e09 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:55.980397 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-be201d81-1e46-4b6d-b822-eb8306f67e09 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:56.122456 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-be201d81-1e46-4b6d-b822-eb8306f67e09 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:56.130781 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-be201d81-1e46-4b6d-b822-eb8306f67e09 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.165431 Sep 02 05:33:56.131473 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 599/1200] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:55 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:56.132848 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-2b30ecb2-11b3-471f-ae51-b36fd80bea32 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:56.133492 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-2b30ecb2-11b3-471f-ae51-b36fd80bea32 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:56.139992 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2b30ecb2-11b3-471f-ae51-b36fd80bea32 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:56.140500 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2b30ecb2-11b3-471f-ae51-b36fd80bea32 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:56.140972 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2b30ecb2-11b3-471f-ae51-b36fd80bea32 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:56.141668 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2b30ecb2-11b3-471f-ae51-b36fd80bea32 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:56.142127 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2b30ecb2-11b3-471f-ae51-b36fd80bea32 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:56.142548 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2b30ecb2-11b3-471f-ae51-b36fd80bea32 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:56.269153 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-2b30ecb2-11b3-471f-ae51-b36fd80bea32 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:56.277705 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-2b30ecb2-11b3-471f-ae51-b36fd80bea32 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.148890 Sep 02 05:33:56.278284 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 602/1201] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:56 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:33:56.933444 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-19e8ac9b-f6a7-4ed5-ace3-49a10f92cb80 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:56.934429 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-19e8ac9b-f6a7-4ed5-ace3-49a10f92cb80 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:56.944632 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19e8ac9b-f6a7-4ed5-ace3-49a10f92cb80 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:56.945417 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19e8ac9b-f6a7-4ed5-ace3-49a10f92cb80 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:56.946124 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19e8ac9b-f6a7-4ed5-ace3-49a10f92cb80 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:56.947261 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19e8ac9b-f6a7-4ed5-ace3-49a10f92cb80 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:56.947999 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19e8ac9b-f6a7-4ed5-ace3-49a10f92cb80 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:56.948739 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19e8ac9b-f6a7-4ed5-ace3-49a10f92cb80 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:57.102827 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-19e8ac9b-f6a7-4ed5-ace3-49a10f92cb80 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:57.111464 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-19e8ac9b-f6a7-4ed5-ace3-49a10f92cb80 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:57.112956 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-19e8ac9b-f6a7-4ed5-ace3-49a10f92cb80 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:57.114118 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-19e8ac9b-f6a7-4ed5-ace3-49a10f92cb80 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1671 microversion: 2.20 time: 0.187309 Sep 02 05:33:57.114675 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 600/1202] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:56 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1671 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:57.152395 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-86e92a1b-fbf7-4efe-9402-b6e389c61d50 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:57.153013 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-86e92a1b-fbf7-4efe-9402-b6e389c61d50 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:57.160018 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-86e92a1b-fbf7-4efe-9402-b6e389c61d50 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:57.160841 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-86e92a1b-fbf7-4efe-9402-b6e389c61d50 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:57.161624 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-86e92a1b-fbf7-4efe-9402-b6e389c61d50 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:57.162564 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-86e92a1b-fbf7-4efe-9402-b6e389c61d50 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:57.163022 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-86e92a1b-fbf7-4efe-9402-b6e389c61d50 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:57.163478 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-86e92a1b-fbf7-4efe-9402-b6e389c61d50 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:57.298858 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-1fb7473e-d439-44cb-9083-d6deb39d98ad tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:57.299475 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-1fb7473e-d439-44cb-9083-d6deb39d98ad tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:57.302875 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-86e92a1b-fbf7-4efe-9402-b6e389c61d50 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:57.305692 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1fb7473e-d439-44cb-9083-d6deb39d98ad tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:57.306210 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1fb7473e-d439-44cb-9083-d6deb39d98ad tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:57.306642 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1fb7473e-d439-44cb-9083-d6deb39d98ad tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:57.307337 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1fb7473e-d439-44cb-9083-d6deb39d98ad tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:57.307787 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1fb7473e-d439-44cb-9083-d6deb39d98ad tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:57.308241 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1fb7473e-d439-44cb-9083-d6deb39d98ad tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:57.310604 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-86e92a1b-fbf7-4efe-9402-b6e389c61d50 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.162172 Sep 02 05:33:57.311178 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 603/1203] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:57 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:57.444285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-1fb7473e-d439-44cb-9083-d6deb39d98ad tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:57.457359 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-1fb7473e-d439-44cb-9083-d6deb39d98ad tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.161947 Sep 02 05:33:57.458193 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 601/1204] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:57 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:58.149797 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-bc518668-4b0c-48d0-8bdf-771a639a10d2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:58.150804 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-bc518668-4b0c-48d0-8bdf-771a639a10d2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:58.158993 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bc518668-4b0c-48d0-8bdf-771a639a10d2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:58.159590 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bc518668-4b0c-48d0-8bdf-771a639a10d2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:58.159885 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bc518668-4b0c-48d0-8bdf-771a639a10d2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:58.160613 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bc518668-4b0c-48d0-8bdf-771a639a10d2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:58.161062 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bc518668-4b0c-48d0-8bdf-771a639a10d2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:58.161487 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bc518668-4b0c-48d0-8bdf-771a639a10d2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:58.300710 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-bc518668-4b0c-48d0-8bdf-771a639a10d2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:58.309419 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-bc518668-4b0c-48d0-8bdf-771a639a10d2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:58.310837 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-bc518668-4b0c-48d0-8bdf-771a639a10d2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:58.312329 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-bc518668-4b0c-48d0-8bdf-771a639a10d2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1671 microversion: 2.20 time: 0.168941 Sep 02 05:33:58.312894 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 604/1205] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:58 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1671 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:58.334441 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-37350300-c4c9-4ce5-9b8f-6dbb25903dc3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:58.335444 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-37350300-c4c9-4ce5-9b8f-6dbb25903dc3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:58.345612 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-37350300-c4c9-4ce5-9b8f-6dbb25903dc3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:58.346379 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-37350300-c4c9-4ce5-9b8f-6dbb25903dc3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:58.347013 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-37350300-c4c9-4ce5-9b8f-6dbb25903dc3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:58.348086 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-37350300-c4c9-4ce5-9b8f-6dbb25903dc3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:58.348738 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-37350300-c4c9-4ce5-9b8f-6dbb25903dc3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:58.349374 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-37350300-c4c9-4ce5-9b8f-6dbb25903dc3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:58.483118 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-d8afb32e-4dc0-4a9e-9936-1ff61f9c0f7b tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:58.483818 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-d8afb32e-4dc0-4a9e-9936-1ff61f9c0f7b tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:58.486073 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:33:58.492153 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d8afb32e-4dc0-4a9e-9936-1ff61f9c0f7b tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:58.492666 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d8afb32e-4dc0-4a9e-9936-1ff61f9c0f7b tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:58.493137 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d8afb32e-4dc0-4a9e-9936-1ff61f9c0f7b tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:58.493840 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d8afb32e-4dc0-4a9e-9936-1ff61f9c0f7b tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:58.494299 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d8afb32e-4dc0-4a9e-9936-1ff61f9c0f7b tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:58.494713 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d8afb32e-4dc0-4a9e-9936-1ff61f9c0f7b tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:58.502547 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-37350300-c4c9-4ce5-9b8f-6dbb25903dc3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:58.510501 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-37350300-c4c9-4ce5-9b8f-6dbb25903dc3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.181280 Sep 02 05:33:58.511107 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 602/1206] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:58 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:58.665421 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-d8afb32e-4dc0-4a9e-9936-1ff61f9c0f7b tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:58.674166 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-d8afb32e-4dc0-4a9e-9936-1ff61f9c0f7b tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.194996 Sep 02 05:33:58.675108 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 605/1207] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:58 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:59.225022 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-54d294bf-d684-4ce8-9353-bad0381e84d7 req-829a7696-b19c-4ebe-8e41-0e4549a73812 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1051c26e-620c-419e-8b92-69c6a09b79ba", "tag": "45c24232-6095-4cd2-8644-d456619c27ed"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:33:59.234604 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-54d294bf-d684-4ce8-9353-bad0381e84d7 req-829a7696-b19c-4ebe-8e41-0e4549a73812 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:59.235072 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-54d294bf-d684-4ce8-9353-bad0381e84d7 req-829a7696-b19c-4ebe-8e41-0e4549a73812 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:59.235496 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-54d294bf-d684-4ce8-9353-bad0381e84d7 req-829a7696-b19c-4ebe-8e41-0e4549a73812 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:59.246444 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-54d294bf-d684-4ce8-9353-bad0381e84d7 req-829a7696-b19c-4ebe-8e41-0e4549a73812 service nova] Creating event network-changed:45c24232-6095-4cd2-8644-d456619c27ed for instance 1051c26e-620c-419e-8b92-69c6a09b79ba on hv-cinder-85391 Sep 02 05:33:59.251465 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-54d294bf-d684-4ce8-9353-bad0381e84d7 req-829a7696-b19c-4ebe-8e41-0e4549a73812 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031299 Sep 02 05:33:59.252505 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 603/1208] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 05:33:59.346129 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-a66977e1-4a5c-4dff-bf5c-7cf9358978d7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:59.347105 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-a66977e1-4a5c-4dff-bf5c-7cf9358978d7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:59.357897 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a66977e1-4a5c-4dff-bf5c-7cf9358978d7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:59.358775 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a66977e1-4a5c-4dff-bf5c-7cf9358978d7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:59.359209 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a66977e1-4a5c-4dff-bf5c-7cf9358978d7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:59.359904 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a66977e1-4a5c-4dff-bf5c-7cf9358978d7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:59.360394 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a66977e1-4a5c-4dff-bf5c-7cf9358978d7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:59.361172 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a66977e1-4a5c-4dff-bf5c-7cf9358978d7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:59.505341 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-a66977e1-4a5c-4dff-bf5c-7cf9358978d7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:59.518567 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-a66977e1-4a5c-4dff-bf5c-7cf9358978d7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:59.520714 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-a66977e1-4a5c-4dff-bf5c-7cf9358978d7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:59.522516 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-a66977e1-4a5c-4dff-bf5c-7cf9358978d7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1729 microversion: 2.20 time: 0.185771 Sep 02 05:33:59.523279 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 606/1209] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:33:59 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:33:59.531599 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-85a37657-3c57-4d05-a82a-f5731dfca2ca tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:59.532322 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-85a37657-3c57-4d05-a82a-f5731dfca2ca tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:59.539269 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-85a37657-3c57-4d05-a82a-f5731dfca2ca tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:59.539747 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-85a37657-3c57-4d05-a82a-f5731dfca2ca tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:59.540167 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-85a37657-3c57-4d05-a82a-f5731dfca2ca tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:59.540858 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-85a37657-3c57-4d05-a82a-f5731dfca2ca tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:59.541303 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-85a37657-3c57-4d05-a82a-f5731dfca2ca tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:59.541718 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-85a37657-3c57-4d05-a82a-f5731dfca2ca tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:59.674310 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-85a37657-3c57-4d05-a82a-f5731dfca2ca tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:59.681991 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-85a37657-3c57-4d05-a82a-f5731dfca2ca tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.154683 Sep 02 05:33:59.682561 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 604/1210] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:59 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:33:59.694880 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-1abb609d-cd0e-43f4-bc93-1a8604516f26 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:33:59.695498 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-1abb609d-cd0e-43f4-bc93-1a8604516f26 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:33:59.703967 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1abb609d-cd0e-43f4-bc93-1a8604516f26 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:59.704714 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1abb609d-cd0e-43f4-bc93-1a8604516f26 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:59.705223 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1abb609d-cd0e-43f4-bc93-1a8604516f26 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:59.706273 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1abb609d-cd0e-43f4-bc93-1a8604516f26 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:33:59.706801 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1abb609d-cd0e-43f4-bc93-1a8604516f26 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:33:59.707424 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1abb609d-cd0e-43f4-bc93-1a8604516f26 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:33:59.835760 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1abb609d-cd0e-43f4-bc93-1a8604516f26 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:33:59.843831 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-1abb609d-cd0e-43f4-bc93-1a8604516f26 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.152882 Sep 02 05:33:59.844445 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 607/1211] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:33:59 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:00.550583 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-7c0d3240-f851-4ca4-8fdd-7891b7bdd5dc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:00.551549 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-7c0d3240-f851-4ca4-8fdd-7891b7bdd5dc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:00.562344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7c0d3240-f851-4ca4-8fdd-7891b7bdd5dc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:00.562828 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7c0d3240-f851-4ca4-8fdd-7891b7bdd5dc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:00.563263 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7c0d3240-f851-4ca4-8fdd-7891b7bdd5dc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:00.563956 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7c0d3240-f851-4ca4-8fdd-7891b7bdd5dc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:00.564433 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7c0d3240-f851-4ca4-8fdd-7891b7bdd5dc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:00.564853 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7c0d3240-f851-4ca4-8fdd-7891b7bdd5dc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:00.702995 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-7c0d3240-f851-4ca4-8fdd-7891b7bdd5dc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:00.703344 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-aeaaa3f7-38f0-47e9-b60c-f1fb6670bc6c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:00.703960 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-aeaaa3f7-38f0-47e9-b60c-f1fb6670bc6c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:00.710284 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-aeaaa3f7-38f0-47e9-b60c-f1fb6670bc6c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:00.710765 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-aeaaa3f7-38f0-47e9-b60c-f1fb6670bc6c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:00.711195 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-aeaaa3f7-38f0-47e9-b60c-f1fb6670bc6c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:00.711378 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-7c0d3240-f851-4ca4-8fdd-7891b7bdd5dc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:00.711880 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-aeaaa3f7-38f0-47e9-b60c-f1fb6670bc6c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:00.712367 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-aeaaa3f7-38f0-47e9-b60c-f1fb6670bc6c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:00.712787 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-aeaaa3f7-38f0-47e9-b60c-f1fb6670bc6c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:00.712891 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-7c0d3240-f851-4ca4-8fdd-7891b7bdd5dc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:00.714051 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-7c0d3240-f851-4ca4-8fdd-7891b7bdd5dc tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1729 microversion: 2.20 time: 0.170128 Sep 02 05:34:00.714613 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 605/1212] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:34:00 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:34:00.841859 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-aeaaa3f7-38f0-47e9-b60c-f1fb6670bc6c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:00.850193 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-aeaaa3f7-38f0-47e9-b60c-f1fb6670bc6c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.151028 Sep 02 05:34:00.850763 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 608/1213] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:00 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:00.864733 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d02f1b2e-e6cc-4534-8904-ef5425b6abd2 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:00.865346 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-d02f1b2e-e6cc-4534-8904-ef5425b6abd2 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:00.871678 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d02f1b2e-e6cc-4534-8904-ef5425b6abd2 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:00.872157 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d02f1b2e-e6cc-4534-8904-ef5425b6abd2 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:00.872619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d02f1b2e-e6cc-4534-8904-ef5425b6abd2 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:00.873317 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d02f1b2e-e6cc-4534-8904-ef5425b6abd2 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:00.873766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d02f1b2e-e6cc-4534-8904-ef5425b6abd2 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:00.874189 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d02f1b2e-e6cc-4534-8904-ef5425b6abd2 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:01.007675 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-d02f1b2e-e6cc-4534-8904-ef5425b6abd2 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:01.016241 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-d02f1b2e-e6cc-4534-8904-ef5425b6abd2 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.155706 Sep 02 05:34:01.016815 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 606/1214] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:00 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:01.739488 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-abcf3516-6d3e-4c51-a822-75be98548685 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:01.740279 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-abcf3516-6d3e-4c51-a822-75be98548685 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:01.748796 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-abcf3516-6d3e-4c51-a822-75be98548685 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:01.749433 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-abcf3516-6d3e-4c51-a822-75be98548685 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:01.749883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-abcf3516-6d3e-4c51-a822-75be98548685 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:01.750567 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-abcf3516-6d3e-4c51-a822-75be98548685 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:01.751020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-abcf3516-6d3e-4c51-a822-75be98548685 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:01.751442 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-abcf3516-6d3e-4c51-a822-75be98548685 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:01.872465 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-8c20eb8e-2d70-48f8-981f-96970c1066fc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:01.873054 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-8c20eb8e-2d70-48f8-981f-96970c1066fc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:01.880191 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8c20eb8e-2d70-48f8-981f-96970c1066fc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:01.880675 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8c20eb8e-2d70-48f8-981f-96970c1066fc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:01.881101 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8c20eb8e-2d70-48f8-981f-96970c1066fc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:01.881785 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8c20eb8e-2d70-48f8-981f-96970c1066fc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:01.882229 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8c20eb8e-2d70-48f8-981f-96970c1066fc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:01.882586 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-abcf3516-6d3e-4c51-a822-75be98548685 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:01.882715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8c20eb8e-2d70-48f8-981f-96970c1066fc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:01.890921 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-abcf3516-6d3e-4c51-a822-75be98548685 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:01.892406 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-abcf3516-6d3e-4c51-a822-75be98548685 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:01.893582 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-abcf3516-6d3e-4c51-a822-75be98548685 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1729 microversion: 2.20 time: 0.159404 Sep 02 05:34:01.894167 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 609/1215] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:34:01 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:34:02.017596 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-8c20eb8e-2d70-48f8-981f-96970c1066fc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:02.028168 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-8c20eb8e-2d70-48f8-981f-96970c1066fc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.159665 Sep 02 05:34:02.028781 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 607/1216] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:01 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:02.037593 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-0c2472c0-bed3-4244-9039-acd5598b0d74 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:02.038241 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-0c2472c0-bed3-4244-9039-acd5598b0d74 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:02.044500 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0c2472c0-bed3-4244-9039-acd5598b0d74 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:02.044982 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0c2472c0-bed3-4244-9039-acd5598b0d74 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:02.045416 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0c2472c0-bed3-4244-9039-acd5598b0d74 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:02.046201 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0c2472c0-bed3-4244-9039-acd5598b0d74 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:02.046724 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0c2472c0-bed3-4244-9039-acd5598b0d74 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:02.047176 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0c2472c0-bed3-4244-9039-acd5598b0d74 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:02.273575 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-0c2472c0-bed3-4244-9039-acd5598b0d74 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:02.281506 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-0c2472c0-bed3-4244-9039-acd5598b0d74 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.248053 Sep 02 05:34:02.282108 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 610/1217] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:02 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:02.919275 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-dae46fec-799a-4f41-abfc-afc71787e700 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:02.920212 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-dae46fec-799a-4f41-abfc-afc71787e700 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:02.927968 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dae46fec-799a-4f41-abfc-afc71787e700 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:02.928811 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dae46fec-799a-4f41-abfc-afc71787e700 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:02.929341 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dae46fec-799a-4f41-abfc-afc71787e700 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:02.930541 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dae46fec-799a-4f41-abfc-afc71787e700 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:02.931218 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dae46fec-799a-4f41-abfc-afc71787e700 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:02.931882 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dae46fec-799a-4f41-abfc-afc71787e700 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:03.049746 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-07be4728-f1d9-40cb-b563-cf5ad1bdfe79 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:03.050383 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-07be4728-f1d9-40cb-b563-cf5ad1bdfe79 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:03.057423 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-07be4728-f1d9-40cb-b563-cf5ad1bdfe79 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:03.057906 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-07be4728-f1d9-40cb-b563-cf5ad1bdfe79 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:03.058335 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-07be4728-f1d9-40cb-b563-cf5ad1bdfe79 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:03.059048 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-07be4728-f1d9-40cb-b563-cf5ad1bdfe79 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:03.059485 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-07be4728-f1d9-40cb-b563-cf5ad1bdfe79 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:03.059900 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-07be4728-f1d9-40cb-b563-cf5ad1bdfe79 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:03.071877 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-dae46fec-799a-4f41-abfc-afc71787e700 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:03.077159 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=100 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:03.081675 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-dae46fec-799a-4f41-abfc-afc71787e700 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:03.083280 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-dae46fec-799a-4f41-abfc-afc71787e700 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:03.084604 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-dae46fec-799a-4f41-abfc-afc71787e700 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1729 microversion: 2.20 time: 0.170223 Sep 02 05:34:03.085180 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 608/1218] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:34:02 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:34:03.196408 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-07be4728-f1d9-40cb-b563-cf5ad1bdfe79 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:03.204446 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-07be4728-f1d9-40cb-b563-cf5ad1bdfe79 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.158685 Sep 02 05:34:03.205067 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 611/1219] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:03 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:34:03.302916 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-19992bb1-754e-4357-b2d0-2c4761473e48 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:03.303530 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-19992bb1-754e-4357-b2d0-2c4761473e48 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:03.309945 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19992bb1-754e-4357-b2d0-2c4761473e48 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:03.310427 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19992bb1-754e-4357-b2d0-2c4761473e48 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:03.310849 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19992bb1-754e-4357-b2d0-2c4761473e48 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:03.311568 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19992bb1-754e-4357-b2d0-2c4761473e48 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:03.312066 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19992bb1-754e-4357-b2d0-2c4761473e48 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:03.312554 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-19992bb1-754e-4357-b2d0-2c4761473e48 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:03.330576 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=100 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:03.450326 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-19992bb1-754e-4357-b2d0-2c4761473e48 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:03.458144 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-19992bb1-754e-4357-b2d0-2c4761473e48 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.159294 Sep 02 05:34:03.459053 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 609/1220] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:03 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:04.113188 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-1d2e1620-b9f0-47ca-84a0-5aa4c84db063 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:04.114049 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-1d2e1620-b9f0-47ca-84a0-5aa4c84db063 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:04.124856 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1d2e1620-b9f0-47ca-84a0-5aa4c84db063 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:04.125335 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1d2e1620-b9f0-47ca-84a0-5aa4c84db063 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:04.125769 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1d2e1620-b9f0-47ca-84a0-5aa4c84db063 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:04.126442 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1d2e1620-b9f0-47ca-84a0-5aa4c84db063 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:04.126892 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1d2e1620-b9f0-47ca-84a0-5aa4c84db063 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:04.127316 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1d2e1620-b9f0-47ca-84a0-5aa4c84db063 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:04.225398 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-73690358-fa13-45b9-821a-799526aa3bd4 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:04.225965 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-73690358-fa13-45b9-821a-799526aa3bd4 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:04.233051 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-73690358-fa13-45b9-821a-799526aa3bd4 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:04.233534 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-73690358-fa13-45b9-821a-799526aa3bd4 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:04.233961 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-73690358-fa13-45b9-821a-799526aa3bd4 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:04.234646 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-73690358-fa13-45b9-821a-799526aa3bd4 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:04.235085 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-73690358-fa13-45b9-821a-799526aa3bd4 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:04.235509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-73690358-fa13-45b9-821a-799526aa3bd4 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:04.268500 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1d2e1620-b9f0-47ca-84a0-5aa4c84db063 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:04.277172 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1d2e1620-b9f0-47ca-84a0-5aa4c84db063 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:04.278640 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1d2e1620-b9f0-47ca-84a0-5aa4c84db063 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:04.279814 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-1d2e1620-b9f0-47ca-84a0-5aa4c84db063 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1729 microversion: 2.20 time: 0.173940 Sep 02 05:34:04.280463 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 612/1221] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:34:04 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:34:04.370411 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-73690358-fa13-45b9-821a-799526aa3bd4 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:04.383619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-73690358-fa13-45b9-821a-799526aa3bd4 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.161466 Sep 02 05:34:04.384519 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 610/1222] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:04 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:04.482960 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-446fffb7-9b06-4ba6-bcf1-65762ba70877 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:04.484156 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-446fffb7-9b06-4ba6-bcf1-65762ba70877 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:04.491701 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-446fffb7-9b06-4ba6-bcf1-65762ba70877 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:04.492278 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-446fffb7-9b06-4ba6-bcf1-65762ba70877 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:04.492764 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-446fffb7-9b06-4ba6-bcf1-65762ba70877 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:04.493542 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-446fffb7-9b06-4ba6-bcf1-65762ba70877 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:04.494044 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-446fffb7-9b06-4ba6-bcf1-65762ba70877 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:04.494515 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-446fffb7-9b06-4ba6-bcf1-65762ba70877 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:04.644295 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-446fffb7-9b06-4ba6-bcf1-65762ba70877 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:04.652767 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-446fffb7-9b06-4ba6-bcf1-65762ba70877 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.176223 Sep 02 05:34:04.653354 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 613/1223] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:04 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:05.087237 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-ca46c74e-6a8e-4723-b420-4b19dfbaa3a2 req-dc004318-09f8-41d1-9e6c-45feb660ad64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d19306c3-935d-4876-9adb-651da56d0574", "name": "network-vif-plugged", "status": "completed", "tag": "e83b7424-9d82-42cb-813a-c872cb5208ac"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:34:05.097938 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-ca46c74e-6a8e-4723-b420-4b19dfbaa3a2 req-dc004318-09f8-41d1-9e6c-45feb660ad64 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:05.098407 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-ca46c74e-6a8e-4723-b420-4b19dfbaa3a2 req-dc004318-09f8-41d1-9e6c-45feb660ad64 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:05.098829 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-ca46c74e-6a8e-4723-b420-4b19dfbaa3a2 req-dc004318-09f8-41d1-9e6c-45feb660ad64 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:05.110991 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-ca46c74e-6a8e-4723-b420-4b19dfbaa3a2 req-dc004318-09f8-41d1-9e6c-45feb660ad64 service nova] Creating event network-vif-plugged:e83b7424-9d82-42cb-813a-c872cb5208ac for instance d19306c3-935d-4876-9adb-651da56d0574 on hv-cinder-85391 Sep 02 05:34:05.116024 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-ca46c74e-6a8e-4723-b420-4b19dfbaa3a2 req-dc004318-09f8-41d1-9e6c-45feb660ad64 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032678 Sep 02 05:34:05.116860 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 611/1224] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:34:05.307107 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-42d8c5fa-a1a4-4a99-9a3d-0bc315d70f8d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:05.307969 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-42d8c5fa-a1a4-4a99-9a3d-0bc315d70f8d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:05.318742 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-42d8c5fa-a1a4-4a99-9a3d-0bc315d70f8d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:05.319536 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-42d8c5fa-a1a4-4a99-9a3d-0bc315d70f8d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:05.320295 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-42d8c5fa-a1a4-4a99-9a3d-0bc315d70f8d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:05.321425 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-42d8c5fa-a1a4-4a99-9a3d-0bc315d70f8d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:05.322172 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-42d8c5fa-a1a4-4a99-9a3d-0bc315d70f8d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:05.322874 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-42d8c5fa-a1a4-4a99-9a3d-0bc315d70f8d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:05.408343 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f3de8fb0-a1f2-41a2-9aaa-de2400b0243b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:05.409228 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f3de8fb0-a1f2-41a2-9aaa-de2400b0243b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:05.416925 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f3de8fb0-a1f2-41a2-9aaa-de2400b0243b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:05.417412 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f3de8fb0-a1f2-41a2-9aaa-de2400b0243b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:05.417847 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f3de8fb0-a1f2-41a2-9aaa-de2400b0243b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:05.418541 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f3de8fb0-a1f2-41a2-9aaa-de2400b0243b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:05.418992 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f3de8fb0-a1f2-41a2-9aaa-de2400b0243b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:05.419413 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f3de8fb0-a1f2-41a2-9aaa-de2400b0243b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:05.734406 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-42d8c5fa-a1a4-4a99-9a3d-0bc315d70f8d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:05.743406 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-42d8c5fa-a1a4-4a99-9a3d-0bc315d70f8d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:05.744884 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-42d8c5fa-a1a4-4a99-9a3d-0bc315d70f8d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:05.746066 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-42d8c5fa-a1a4-4a99-9a3d-0bc315d70f8d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1729 microversion: 2.20 time: 0.445580 Sep 02 05:34:05.746637 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 614/1225] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:34:05 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1729 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:34:05.751073 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-493f08d9-9a28-4d2b-8639-e4f4e26ac3a7 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:05.751653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-493f08d9-9a28-4d2b-8639-e4f4e26ac3a7 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:05.757714 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-493f08d9-9a28-4d2b-8639-e4f4e26ac3a7 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:05.758203 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-493f08d9-9a28-4d2b-8639-e4f4e26ac3a7 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:05.758607 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-493f08d9-9a28-4d2b-8639-e4f4e26ac3a7 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:05.759326 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-493f08d9-9a28-4d2b-8639-e4f4e26ac3a7 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:05.759774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-493f08d9-9a28-4d2b-8639-e4f4e26ac3a7 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:05.760225 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-493f08d9-9a28-4d2b-8639-e4f4e26ac3a7 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:05.862471 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f3de8fb0-a1f2-41a2-9aaa-de2400b0243b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:05.870809 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f3de8fb0-a1f2-41a2-9aaa-de2400b0243b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.467533 Sep 02 05:34:05.871468 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 612/1226] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:05 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:05.906147 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-493f08d9-9a28-4d2b-8639-e4f4e26ac3a7 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:05.914171 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-493f08d9-9a28-4d2b-8639-e4f4e26ac3a7 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.166551 Sep 02 05:34:05.914742 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 615/1227] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:05 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:06.772532 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-40e103fa-9ead-42d7-8a2a-f48b2c75ce24 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:06.773524 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-40e103fa-9ead-42d7-8a2a-f48b2c75ce24 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:06.784375 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-40e103fa-9ead-42d7-8a2a-f48b2c75ce24 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:06.785161 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-40e103fa-9ead-42d7-8a2a-f48b2c75ce24 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:06.785880 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-40e103fa-9ead-42d7-8a2a-f48b2c75ce24 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:06.787003 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-40e103fa-9ead-42d7-8a2a-f48b2c75ce24 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:06.787744 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-40e103fa-9ead-42d7-8a2a-f48b2c75ce24 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:06.788574 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-40e103fa-9ead-42d7-8a2a-f48b2c75ce24 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:06.891821 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-cba03911-5e02-44b5-b412-4d09b79a9f21 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:06.892503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-cba03911-5e02-44b5-b412-4d09b79a9f21 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:06.900277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cba03911-5e02-44b5-b412-4d09b79a9f21 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:06.901028 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cba03911-5e02-44b5-b412-4d09b79a9f21 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:06.901463 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cba03911-5e02-44b5-b412-4d09b79a9f21 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:06.902129 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cba03911-5e02-44b5-b412-4d09b79a9f21 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:06.902955 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cba03911-5e02-44b5-b412-4d09b79a9f21 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:06.904144 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-cba03911-5e02-44b5-b412-4d09b79a9f21 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:06.931289 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-40e103fa-9ead-42d7-8a2a-f48b2c75ce24 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:06.940841 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-40e103fa-9ead-42d7-8a2a-f48b2c75ce24 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:06.942285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-40e103fa-9ead-42d7-8a2a-f48b2c75ce24 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:06.943460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-40e103fa-9ead-42d7-8a2a-f48b2c75ce24 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1729 microversion: 2.20 time: 0.177570 Sep 02 05:34:06.956455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 613/1228] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:34:06 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:34:06.956455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-ab1df657-7c81-476b-8286-8f6e29b63875 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:06.956455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-ab1df657-7c81-476b-8286-8f6e29b63875 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:06.956455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ab1df657-7c81-476b-8286-8f6e29b63875 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:06.956899 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ab1df657-7c81-476b-8286-8f6e29b63875 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:06.956899 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ab1df657-7c81-476b-8286-8f6e29b63875 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:06.956899 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ab1df657-7c81-476b-8286-8f6e29b63875 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:06.959947 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ab1df657-7c81-476b-8286-8f6e29b63875 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:06.959947 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ab1df657-7c81-476b-8286-8f6e29b63875 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:07.090764 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-cba03911-5e02-44b5-b412-4d09b79a9f21 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:07.099287 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-cba03911-5e02-44b5-b412-4d09b79a9f21 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.211357 Sep 02 05:34:07.101235 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 616/1229] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:06 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:07.127032 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-ab1df657-7c81-476b-8286-8f6e29b63875 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:07.135833 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-ab1df657-7c81-476b-8286-8f6e29b63875 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.190502 Sep 02 05:34:07.136600 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 614/1230] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:06 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:07.970452 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-c5a66607-c260-4e8f-9491-542f23190dc0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:07.971905 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-c5a66607-c260-4e8f-9491-542f23190dc0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:07.980360 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c5a66607-c260-4e8f-9491-542f23190dc0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:07.981525 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c5a66607-c260-4e8f-9491-542f23190dc0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:07.982357 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c5a66607-c260-4e8f-9491-542f23190dc0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:07.983597 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c5a66607-c260-4e8f-9491-542f23190dc0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:07.984447 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c5a66607-c260-4e8f-9491-542f23190dc0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:07.985247 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c5a66607-c260-4e8f-9491-542f23190dc0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:08.122489 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-1ef78367-3b5a-42ba-adc8-2e71f74b65d1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:08.123130 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-1ef78367-3b5a-42ba-adc8-2e71f74b65d1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:08.131796 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1ef78367-3b5a-42ba-adc8-2e71f74b65d1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:08.132347 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1ef78367-3b5a-42ba-adc8-2e71f74b65d1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:08.132930 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1ef78367-3b5a-42ba-adc8-2e71f74b65d1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:08.133635 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1ef78367-3b5a-42ba-adc8-2e71f74b65d1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:08.134552 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1ef78367-3b5a-42ba-adc8-2e71f74b65d1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:08.134552 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1ef78367-3b5a-42ba-adc8-2e71f74b65d1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:08.146491 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-c5a66607-c260-4e8f-9491-542f23190dc0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:08.156319 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-c5a66607-c260-4e8f-9491-542f23190dc0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:08.157793 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-c5a66607-c260-4e8f-9491-542f23190dc0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:08.159008 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-c5a66607-c260-4e8f-9491-542f23190dc0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1729 microversion: 2.20 time: 0.194359 Sep 02 05:34:08.159738 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 617/1231] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:34:07 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:34:08.178213 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-4d206c57-8521-4822-84b1-45e3c044e088 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:08.178836 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-4d206c57-8521-4822-84b1-45e3c044e088 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:08.185715 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4d206c57-8521-4822-84b1-45e3c044e088 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:08.186209 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4d206c57-8521-4822-84b1-45e3c044e088 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:08.186645 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4d206c57-8521-4822-84b1-45e3c044e088 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:08.187353 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4d206c57-8521-4822-84b1-45e3c044e088 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:08.187853 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4d206c57-8521-4822-84b1-45e3c044e088 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:08.188346 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4d206c57-8521-4822-84b1-45e3c044e088 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:08.377005 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-1ef78367-3b5a-42ba-adc8-2e71f74b65d1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:08.381150 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-4d206c57-8521-4822-84b1-45e3c044e088 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:08.386360 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-1ef78367-3b5a-42ba-adc8-2e71f74b65d1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.267768 Sep 02 05:34:08.387156 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 615/1232] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:08 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:08.390643 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-4d206c57-8521-4822-84b1-45e3c044e088 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.224781 Sep 02 05:34:08.391323 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 618/1233] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:08 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:09.182747 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-3d4bf1e8-104c-43a4-a5c1-05a31f079218 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:09.183386 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-3d4bf1e8-104c-43a4-a5c1-05a31f079218 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:09.190291 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3d4bf1e8-104c-43a4-a5c1-05a31f079218 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:09.190769 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3d4bf1e8-104c-43a4-a5c1-05a31f079218 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:09.191217 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3d4bf1e8-104c-43a4-a5c1-05a31f079218 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:09.191954 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3d4bf1e8-104c-43a4-a5c1-05a31f079218 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:09.192433 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3d4bf1e8-104c-43a4-a5c1-05a31f079218 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:09.192856 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3d4bf1e8-104c-43a4-a5c1-05a31f079218 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:09.346715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-3d4bf1e8-104c-43a4-a5c1-05a31f079218 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:09.355220 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-3d4bf1e8-104c-43a4-a5c1-05a31f079218 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:09.356669 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-3d4bf1e8-104c-43a4-a5c1-05a31f079218 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:09.357912 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-3d4bf1e8-104c-43a4-a5c1-05a31f079218 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1729 microversion: 2.20 time: 0.179131 Sep 02 05:34:09.358664 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 616/1234] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:34:09 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:34:09.407727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-6f23dc92-5b5b-495f-8923-f76bc92b4ac9 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:09.408647 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-6f23dc92-5b5b-495f-8923-f76bc92b4ac9 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:09.410727 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-b8d3ebb5-5c48-4f81-a7e0-df65312340dc tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:09.411339 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-b8d3ebb5-5c48-4f81-a7e0-df65312340dc tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:09.416874 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6f23dc92-5b5b-495f-8923-f76bc92b4ac9 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:09.417502 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6f23dc92-5b5b-495f-8923-f76bc92b4ac9 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:09.417736 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b8d3ebb5-5c48-4f81-a7e0-df65312340dc tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:09.418222 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b8d3ebb5-5c48-4f81-a7e0-df65312340dc tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:09.418418 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6f23dc92-5b5b-495f-8923-f76bc92b4ac9 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:09.418649 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b8d3ebb5-5c48-4f81-a7e0-df65312340dc tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:09.419341 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b8d3ebb5-5c48-4f81-a7e0-df65312340dc tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:09.419784 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b8d3ebb5-5c48-4f81-a7e0-df65312340dc tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:09.421495 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b8d3ebb5-5c48-4f81-a7e0-df65312340dc tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:09.421620 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6f23dc92-5b5b-495f-8923-f76bc92b4ac9 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:09.421620 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6f23dc92-5b5b-495f-8923-f76bc92b4ac9 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:09.422903 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6f23dc92-5b5b-495f-8923-f76bc92b4ac9 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:09.670140 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-b8d3ebb5-5c48-4f81-a7e0-df65312340dc tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:09.680839 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-b8d3ebb5-5c48-4f81-a7e0-df65312340dc tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.273812 Sep 02 05:34:09.684280 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 617/1235] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:09 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:34:09.687515 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-6f23dc92-5b5b-495f-8923-f76bc92b4ac9 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:09.696695 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-eb515fc7-ddd0-40a1-8ea2-559b41b78acc req-5e03cec2-9c62-410b-b112-6a7db1513b66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1051c26e-620c-419e-8b92-69c6a09b79ba", "name": "network-vif-plugged", "status": "completed", "tag": "45c24232-6095-4cd2-8644-d456619c27ed"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:34:09.708038 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-6f23dc92-5b5b-495f-8923-f76bc92b4ac9 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.304622 Sep 02 05:34:09.710695 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 619/1236] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:09 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:09.724195 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-eb515fc7-ddd0-40a1-8ea2-559b41b78acc req-5e03cec2-9c62-410b-b112-6a7db1513b66 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:09.724195 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-eb515fc7-ddd0-40a1-8ea2-559b41b78acc req-5e03cec2-9c62-410b-b112-6a7db1513b66 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:09.724195 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-eb515fc7-ddd0-40a1-8ea2-559b41b78acc req-5e03cec2-9c62-410b-b112-6a7db1513b66 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:09.746886 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-eb515fc7-ddd0-40a1-8ea2-559b41b78acc req-5e03cec2-9c62-410b-b112-6a7db1513b66 service nova] Creating event network-vif-plugged:45c24232-6095-4cd2-8644-d456619c27ed for instance 1051c26e-620c-419e-8b92-69c6a09b79ba on hv-cinder-85391 Sep 02 05:34:09.752394 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-eb515fc7-ddd0-40a1-8ea2-559b41b78acc req-5e03cec2-9c62-410b-b112-6a7db1513b66 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066258 Sep 02 05:34:09.753551 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 618/1237] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:34:10.382027 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-0937cc2c-4cf7-410a-8b59-766f8310a916 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:10.382624 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-0937cc2c-4cf7-410a-8b59-766f8310a916 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:10.389043 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0937cc2c-4cf7-410a-8b59-766f8310a916 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:10.389524 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0937cc2c-4cf7-410a-8b59-766f8310a916 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:10.389948 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0937cc2c-4cf7-410a-8b59-766f8310a916 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:10.390744 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0937cc2c-4cf7-410a-8b59-766f8310a916 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:10.391135 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0937cc2c-4cf7-410a-8b59-766f8310a916 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:10.391590 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0937cc2c-4cf7-410a-8b59-766f8310a916 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:10.539934 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-0937cc2c-4cf7-410a-8b59-766f8310a916 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:10.549305 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-0937cc2c-4cf7-410a-8b59-766f8310a916 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:10.550887 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-0937cc2c-4cf7-410a-8b59-766f8310a916 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:10.552247 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-0937cc2c-4cf7-410a-8b59-766f8310a916 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1729 microversion: 2.20 time: 0.174517 Sep 02 05:34:10.553154 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 620/1238] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:34:10 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:34:10.710242 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-211d6808-033d-4981-82c6-45241cd91885 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:10.711096 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-211d6808-033d-4981-82c6-45241cd91885 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:10.720452 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-211d6808-033d-4981-82c6-45241cd91885 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:10.721126 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-211d6808-033d-4981-82c6-45241cd91885 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:10.722019 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-211d6808-033d-4981-82c6-45241cd91885 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:10.722290 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-211d6808-033d-4981-82c6-45241cd91885 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:10.722744 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-211d6808-033d-4981-82c6-45241cd91885 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:10.723467 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-211d6808-033d-4981-82c6-45241cd91885 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:10.740797 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-6eae090a-8fc1-4bfc-b649-44787cf4ee43 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:10.741954 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-6eae090a-8fc1-4bfc-b649-44787cf4ee43 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:10.749021 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6eae090a-8fc1-4bfc-b649-44787cf4ee43 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:10.749508 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6eae090a-8fc1-4bfc-b649-44787cf4ee43 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:10.749939 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6eae090a-8fc1-4bfc-b649-44787cf4ee43 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:10.750730 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6eae090a-8fc1-4bfc-b649-44787cf4ee43 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:10.751177 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6eae090a-8fc1-4bfc-b649-44787cf4ee43 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:10.751593 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6eae090a-8fc1-4bfc-b649-44787cf4ee43 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:10.955244 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-211d6808-033d-4981-82c6-45241cd91885 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:10.963217 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-211d6808-033d-4981-82c6-45241cd91885 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.257788 Sep 02 05:34:10.972013 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-6eae090a-8fc1-4bfc-b649-44787cf4ee43 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:10.976470 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 619/1239] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:10 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:10.980690 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-6eae090a-8fc1-4bfc-b649-44787cf4ee43 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.244620 Sep 02 05:34:10.992336 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 621/1240] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:10 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:11.576508 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-48e36dd8-b44f-4ec3-b333-0a5b7c86a9f8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:11.577122 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-48e36dd8-b44f-4ec3-b333-0a5b7c86a9f8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:11.583829 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-48e36dd8-b44f-4ec3-b333-0a5b7c86a9f8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:11.584353 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-48e36dd8-b44f-4ec3-b333-0a5b7c86a9f8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:11.584799 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-48e36dd8-b44f-4ec3-b333-0a5b7c86a9f8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:11.585674 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-48e36dd8-b44f-4ec3-b333-0a5b7c86a9f8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:11.586420 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-48e36dd8-b44f-4ec3-b333-0a5b7c86a9f8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:11.587069 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-48e36dd8-b44f-4ec3-b333-0a5b7c86a9f8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:11.742369 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-48e36dd8-b44f-4ec3-b333-0a5b7c86a9f8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:11.751428 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-48e36dd8-b44f-4ec3-b333-0a5b7c86a9f8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:11.753155 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-48e36dd8-b44f-4ec3-b333-0a5b7c86a9f8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:11.754576 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-48e36dd8-b44f-4ec3-b333-0a5b7c86a9f8 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1729 microversion: 2.20 time: 0.182198 Sep 02 05:34:11.755264 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 620/1241] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:34:11 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:34:11.983351 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-b0555491-c43e-41d1-ae3d-87d70fa7daee tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:11.983997 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-b0555491-c43e-41d1-ae3d-87d70fa7daee tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:11.991376 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b0555491-c43e-41d1-ae3d-87d70fa7daee tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:11.991861 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b0555491-c43e-41d1-ae3d-87d70fa7daee tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:11.992334 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b0555491-c43e-41d1-ae3d-87d70fa7daee tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:11.993024 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b0555491-c43e-41d1-ae3d-87d70fa7daee tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:11.993489 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b0555491-c43e-41d1-ae3d-87d70fa7daee tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:11.993908 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b0555491-c43e-41d1-ae3d-87d70fa7daee tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:12.002571 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-5af4b1a7-45e6-4b56-82b5-f42a3645a1b7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:12.003176 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-5af4b1a7-45e6-4b56-82b5-f42a3645a1b7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:12.010162 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5af4b1a7-45e6-4b56-82b5-f42a3645a1b7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:12.010658 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5af4b1a7-45e6-4b56-82b5-f42a3645a1b7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:12.011599 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5af4b1a7-45e6-4b56-82b5-f42a3645a1b7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:12.011783 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5af4b1a7-45e6-4b56-82b5-f42a3645a1b7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:12.012433 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5af4b1a7-45e6-4b56-82b5-f42a3645a1b7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:12.012866 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-5af4b1a7-45e6-4b56-82b5-f42a3645a1b7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:12.195519 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-b0555491-c43e-41d1-ae3d-87d70fa7daee tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:12.203222 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-b0555491-c43e-41d1-ae3d-87d70fa7daee tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.223809 Sep 02 05:34:12.203800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 622/1242] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:11 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:12.212568 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-5af4b1a7-45e6-4b56-82b5-f42a3645a1b7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:12.220831 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-5af4b1a7-45e6-4b56-82b5-f42a3645a1b7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.221924 Sep 02 05:34:12.222500 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 621/1243] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:11 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:12.778365 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-c93a2e16-16d8-4ea2-8a07-17a74c66ccc2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:12.778981 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-c93a2e16-16d8-4ea2-8a07-17a74c66ccc2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:12.785897 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c93a2e16-16d8-4ea2-8a07-17a74c66ccc2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:12.786438 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c93a2e16-16d8-4ea2-8a07-17a74c66ccc2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:12.787050 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c93a2e16-16d8-4ea2-8a07-17a74c66ccc2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:12.787764 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c93a2e16-16d8-4ea2-8a07-17a74c66ccc2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:12.788281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c93a2e16-16d8-4ea2-8a07-17a74c66ccc2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:12.788700 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c93a2e16-16d8-4ea2-8a07-17a74c66ccc2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:12.943995 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-c93a2e16-16d8-4ea2-8a07-17a74c66ccc2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:12.952908 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-c93a2e16-16d8-4ea2-8a07-17a74c66ccc2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:12.954276 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-c93a2e16-16d8-4ea2-8a07-17a74c66ccc2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:12.955527 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-c93a2e16-16d8-4ea2-8a07-17a74c66ccc2 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1729 microversion: 2.20 time: 0.181253 Sep 02 05:34:12.956243 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 623/1244] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:34:12 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:34:13.225034 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-46f45b52-ba64-4ff8-b530-8a8ef6bc4af9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:13.226367 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-46f45b52-ba64-4ff8-b530-8a8ef6bc4af9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:13.234449 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-46f45b52-ba64-4ff8-b530-8a8ef6bc4af9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:13.237014 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-46f45b52-ba64-4ff8-b530-8a8ef6bc4af9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:13.237690 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-46f45b52-ba64-4ff8-b530-8a8ef6bc4af9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:13.238831 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-46f45b52-ba64-4ff8-b530-8a8ef6bc4af9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:13.239300 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-46f45b52-ba64-4ff8-b530-8a8ef6bc4af9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:13.239731 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-46f45b52-ba64-4ff8-b530-8a8ef6bc4af9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:13.242291 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-f8d15d94-3d49-4ea4-b6c5-e83451405820 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:13.243469 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-f8d15d94-3d49-4ea4-b6c5-e83451405820 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:13.251529 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f8d15d94-3d49-4ea4-b6c5-e83451405820 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:13.252498 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f8d15d94-3d49-4ea4-b6c5-e83451405820 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:13.252902 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f8d15d94-3d49-4ea4-b6c5-e83451405820 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:13.253630 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f8d15d94-3d49-4ea4-b6c5-e83451405820 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:13.254398 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f8d15d94-3d49-4ea4-b6c5-e83451405820 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:13.255028 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-f8d15d94-3d49-4ea4-b6c5-e83451405820 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:13.464669 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-f8d15d94-3d49-4ea4-b6c5-e83451405820 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:13.464942 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-46f45b52-ba64-4ff8-b530-8a8ef6bc4af9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:13.473140 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-f8d15d94-3d49-4ea4-b6c5-e83451405820 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.234687 Sep 02 05:34:13.484444 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 624/1245] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:13 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:34:13.484640 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-46f45b52-ba64-4ff8-b530-8a8ef6bc4af9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.253393 Sep 02 05:34:13.484640 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 622/1246] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:13 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:13.981110 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-d67ce82f-1d90-459a-a11e-1e55b42b0203 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:13.981821 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-d67ce82f-1d90-459a-a11e-1e55b42b0203 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:13.988841 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d67ce82f-1d90-459a-a11e-1e55b42b0203 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:13.989433 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d67ce82f-1d90-459a-a11e-1e55b42b0203 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:13.989941 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d67ce82f-1d90-459a-a11e-1e55b42b0203 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:13.990644 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d67ce82f-1d90-459a-a11e-1e55b42b0203 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:13.991096 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d67ce82f-1d90-459a-a11e-1e55b42b0203 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:13.991520 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d67ce82f-1d90-459a-a11e-1e55b42b0203 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:14.141025 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-d67ce82f-1d90-459a-a11e-1e55b42b0203 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:14.149674 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-d67ce82f-1d90-459a-a11e-1e55b42b0203 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:14.151135 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-d67ce82f-1d90-459a-a11e-1e55b42b0203 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:14.152500 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-d67ce82f-1d90-459a-a11e-1e55b42b0203 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1729 microversion: 2.20 time: 0.175336 Sep 02 05:34:14.153072 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 625/1247] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:34:13 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:34:14.495262 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-afc368fe-3ada-4d58-96a4-28f11225dd09 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:14.496946 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-afc368fe-3ada-4d58-96a4-28f11225dd09 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:14.497737 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-0c8d74d1-7977-4a71-8d20-fb818a1329f3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:14.498461 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-0c8d74d1-7977-4a71-8d20-fb818a1329f3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:14.505120 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0c8d74d1-7977-4a71-8d20-fb818a1329f3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:14.505357 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-afc368fe-3ada-4d58-96a4-28f11225dd09 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:14.505595 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0c8d74d1-7977-4a71-8d20-fb818a1329f3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:14.506030 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0c8d74d1-7977-4a71-8d20-fb818a1329f3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:14.506744 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0c8d74d1-7977-4a71-8d20-fb818a1329f3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:14.506907 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-afc368fe-3ada-4d58-96a4-28f11225dd09 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:14.507194 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0c8d74d1-7977-4a71-8d20-fb818a1329f3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:14.507609 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0c8d74d1-7977-4a71-8d20-fb818a1329f3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:14.507885 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-afc368fe-3ada-4d58-96a4-28f11225dd09 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:14.508819 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-afc368fe-3ada-4d58-96a4-28f11225dd09 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:14.509241 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-afc368fe-3ada-4d58-96a4-28f11225dd09 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:14.509865 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-afc368fe-3ada-4d58-96a4-28f11225dd09 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:14.715810 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-afc368fe-3ada-4d58-96a4-28f11225dd09 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:14.725820 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-0c8d74d1-7977-4a71-8d20-fb818a1329f3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:14.728985 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-afc368fe-3ada-4d58-96a4-28f11225dd09 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.237809 Sep 02 05:34:14.730247 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 623/1248] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:14 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:14.736853 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-0c8d74d1-7977-4a71-8d20-fb818a1329f3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.242808 Sep 02 05:34:14.746480 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 626/1249] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:14 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:15.175074 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-0f98c4ab-0422-461d-af69-b7f1f5e16575 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:15.175683 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-0f98c4ab-0422-461d-af69-b7f1f5e16575 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:15.182533 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0f98c4ab-0422-461d-af69-b7f1f5e16575 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:15.183083 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0f98c4ab-0422-461d-af69-b7f1f5e16575 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:15.183549 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0f98c4ab-0422-461d-af69-b7f1f5e16575 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:15.184358 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0f98c4ab-0422-461d-af69-b7f1f5e16575 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:15.184792 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0f98c4ab-0422-461d-af69-b7f1f5e16575 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:15.185230 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0f98c4ab-0422-461d-af69-b7f1f5e16575 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:15.341944 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-0f98c4ab-0422-461d-af69-b7f1f5e16575 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:15.350496 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-0f98c4ab-0422-461d-af69-b7f1f5e16575 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:15.351918 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-0f98c4ab-0422-461d-af69-b7f1f5e16575 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:15.353108 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-0f98c4ab-0422-461d-af69-b7f1f5e16575 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1729 microversion: 2.20 time: 0.182038 Sep 02 05:34:15.353847 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 624/1250] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:34:15 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:34:15.750527 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ac178ddb-2714-4d9b-8318-386ec95341bd tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:15.751165 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-ac178ddb-2714-4d9b-8318-386ec95341bd tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:15.757998 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ac178ddb-2714-4d9b-8318-386ec95341bd tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:15.758728 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ac178ddb-2714-4d9b-8318-386ec95341bd tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:15.759325 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ac178ddb-2714-4d9b-8318-386ec95341bd tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:15.759984 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-6848c8fb-c8b7-421c-98c2-b3b95e3fc120 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:15.760566 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ac178ddb-2714-4d9b-8318-386ec95341bd tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:15.760764 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ac178ddb-2714-4d9b-8318-386ec95341bd tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:15.761236 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ac178ddb-2714-4d9b-8318-386ec95341bd tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:15.762084 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-6848c8fb-c8b7-421c-98c2-b3b95e3fc120 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:15.771154 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6848c8fb-c8b7-421c-98c2-b3b95e3fc120 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:15.772133 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6848c8fb-c8b7-421c-98c2-b3b95e3fc120 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:15.772572 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6848c8fb-c8b7-421c-98c2-b3b95e3fc120 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:15.773465 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6848c8fb-c8b7-421c-98c2-b3b95e3fc120 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:15.773931 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6848c8fb-c8b7-421c-98c2-b3b95e3fc120 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:15.774361 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6848c8fb-c8b7-421c-98c2-b3b95e3fc120 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:15.973627 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ac178ddb-2714-4d9b-8318-386ec95341bd tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:15.981906 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-ac178ddb-2714-4d9b-8318-386ec95341bd tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.235538 Sep 02 05:34:15.982496 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 627/1251] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:15 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:15.985383 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-6848c8fb-c8b7-421c-98c2-b3b95e3fc120 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:15.994337 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-6848c8fb-c8b7-421c-98c2-b3b95e3fc120 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.239099 Sep 02 05:34:16.006608 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 625/1252] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:15 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:16.376764 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-06fb6648-795d-443d-87bd-d2655533be46 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:16.377344 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-06fb6648-795d-443d-87bd-d2655533be46 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:16.383813 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-06fb6648-795d-443d-87bd-d2655533be46 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:16.384339 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-06fb6648-795d-443d-87bd-d2655533be46 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:16.384774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-06fb6648-795d-443d-87bd-d2655533be46 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:16.385470 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-06fb6648-795d-443d-87bd-d2655533be46 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:16.385927 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-06fb6648-795d-443d-87bd-d2655533be46 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:16.386331 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-06fb6648-795d-443d-87bd-d2655533be46 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:16.389087 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=100 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:16.526795 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-06fb6648-795d-443d-87bd-d2655533be46 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:16.535578 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-06fb6648-795d-443d-87bd-d2655533be46 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:16.537051 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-06fb6648-795d-443d-87bd-d2655533be46 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:16.538241 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-06fb6648-795d-443d-87bd-d2655533be46 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1729 microversion: 2.20 time: 0.165458 Sep 02 05:34:16.538777 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 628/1253] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:34:16 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:34:17.010861 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f14b107e-56cf-4d8c-bcbe-15964831ea49 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:17.011884 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f14b107e-56cf-4d8c-bcbe-15964831ea49 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:17.018829 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-63c1ddfc-82ca-4a7b-bf9a-e31cd8291c16 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:17.019443 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-63c1ddfc-82ca-4a7b-bf9a-e31cd8291c16 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:17.020882 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f14b107e-56cf-4d8c-bcbe-15964831ea49 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:17.021368 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f14b107e-56cf-4d8c-bcbe-15964831ea49 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:17.021801 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f14b107e-56cf-4d8c-bcbe-15964831ea49 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:17.022524 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f14b107e-56cf-4d8c-bcbe-15964831ea49 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:17.022977 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f14b107e-56cf-4d8c-bcbe-15964831ea49 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:17.023395 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f14b107e-56cf-4d8c-bcbe-15964831ea49 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:17.026140 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-63c1ddfc-82ca-4a7b-bf9a-e31cd8291c16 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:17.026626 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-63c1ddfc-82ca-4a7b-bf9a-e31cd8291c16 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:17.027059 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-63c1ddfc-82ca-4a7b-bf9a-e31cd8291c16 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:17.027749 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-63c1ddfc-82ca-4a7b-bf9a-e31cd8291c16 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:17.028211 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-63c1ddfc-82ca-4a7b-bf9a-e31cd8291c16 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:17.028636 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-63c1ddfc-82ca-4a7b-bf9a-e31cd8291c16 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:17.215063 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f14b107e-56cf-4d8c-bcbe-15964831ea49 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:17.218102 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-63c1ddfc-82ca-4a7b-bf9a-e31cd8291c16 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:17.223382 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f14b107e-56cf-4d8c-bcbe-15964831ea49 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.219110 Sep 02 05:34:17.224076 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 626/1254] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:17 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:17.226167 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-63c1ddfc-82ca-4a7b-bf9a-e31cd8291c16 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.212903 Sep 02 05:34:17.226763 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 629/1255] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:17 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:17.565874 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-667c3059-904f-4bb0-a2fe-10c325d364a4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:17.566540 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-667c3059-904f-4bb0-a2fe-10c325d364a4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:17.574482 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-667c3059-904f-4bb0-a2fe-10c325d364a4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:17.575074 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-667c3059-904f-4bb0-a2fe-10c325d364a4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:17.575607 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-667c3059-904f-4bb0-a2fe-10c325d364a4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:17.576505 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-667c3059-904f-4bb0-a2fe-10c325d364a4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:17.577060 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-667c3059-904f-4bb0-a2fe-10c325d364a4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:17.577586 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-667c3059-904f-4bb0-a2fe-10c325d364a4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:17.599352 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=100 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:17.724849 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-667c3059-904f-4bb0-a2fe-10c325d364a4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:17.733043 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-667c3059-904f-4bb0-a2fe-10c325d364a4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:17.734470 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-667c3059-904f-4bb0-a2fe-10c325d364a4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:17.735639 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-667c3059-904f-4bb0-a2fe-10c325d364a4 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1729 microversion: 2.20 time: 0.176156 Sep 02 05:34:17.736596 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 627/1256] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:34:17 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:34:18.248205 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-5d874bad-6786-4ded-8b8f-e0ed29c4165b tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:18.248982 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-5d874bad-6786-4ded-8b8f-e0ed29c4165b tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:18.250400 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-4f5e1ae4-c729-41a3-adf8-5abfd3875bbf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:18.251451 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-4f5e1ae4-c729-41a3-adf8-5abfd3875bbf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:18.257006 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5d874bad-6786-4ded-8b8f-e0ed29c4165b tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:18.257479 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5d874bad-6786-4ded-8b8f-e0ed29c4165b tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:18.258063 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5d874bad-6786-4ded-8b8f-e0ed29c4165b tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:18.258470 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4f5e1ae4-c729-41a3-adf8-5abfd3875bbf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:18.258623 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5d874bad-6786-4ded-8b8f-e0ed29c4165b tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:18.258935 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4f5e1ae4-c729-41a3-adf8-5abfd3875bbf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:18.259136 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5d874bad-6786-4ded-8b8f-e0ed29c4165b tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:18.259405 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4f5e1ae4-c729-41a3-adf8-5abfd3875bbf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:18.259724 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-5d874bad-6786-4ded-8b8f-e0ed29c4165b tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:18.260200 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4f5e1ae4-c729-41a3-adf8-5abfd3875bbf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:18.260645 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4f5e1ae4-c729-41a3-adf8-5abfd3875bbf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:18.261089 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4f5e1ae4-c729-41a3-adf8-5abfd3875bbf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:18.455548 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-5d874bad-6786-4ded-8b8f-e0ed29c4165b tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:18.458511 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-4f5e1ae4-c729-41a3-adf8-5abfd3875bbf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:18.463581 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-5d874bad-6786-4ded-8b8f-e0ed29c4165b tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.221691 Sep 02 05:34:18.464141 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 630/1257] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:18 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:18.466443 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-4f5e1ae4-c729-41a3-adf8-5abfd3875bbf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.222225 Sep 02 05:34:18.467129 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 628/1258] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:18 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:18.761503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-1faef612-69be-4dc8-a568-14913ab38b0e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:18.762236 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-1faef612-69be-4dc8-a568-14913ab38b0e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:18.769969 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1faef612-69be-4dc8-a568-14913ab38b0e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:18.770443 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1faef612-69be-4dc8-a568-14913ab38b0e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:18.770879 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1faef612-69be-4dc8-a568-14913ab38b0e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:18.771556 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1faef612-69be-4dc8-a568-14913ab38b0e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:18.771998 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1faef612-69be-4dc8-a568-14913ab38b0e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:18.772451 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1faef612-69be-4dc8-a568-14913ab38b0e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:18.916990 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1faef612-69be-4dc8-a568-14913ab38b0e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:18.928896 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1faef612-69be-4dc8-a568-14913ab38b0e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:18.931024 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1faef612-69be-4dc8-a568-14913ab38b0e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:18.932734 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-1faef612-69be-4dc8-a568-14913ab38b0e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1729 microversion: 2.20 time: 0.175920 Sep 02 05:34:18.933496 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 631/1259] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:34:18 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:34:19.489930 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-541e8a77-5fd5-4185-a33d-62059e1e8493 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:19.490614 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-541e8a77-5fd5-4185-a33d-62059e1e8493 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:19.490894 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-1dc1fa13-2f81-4158-8643-8379c84711a7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:19.491608 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-1dc1fa13-2f81-4158-8643-8379c84711a7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:19.497904 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-541e8a77-5fd5-4185-a33d-62059e1e8493 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:19.498437 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-541e8a77-5fd5-4185-a33d-62059e1e8493 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:19.498927 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-541e8a77-5fd5-4185-a33d-62059e1e8493 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:19.499093 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1dc1fa13-2f81-4158-8643-8379c84711a7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:19.499442 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1dc1fa13-2f81-4158-8643-8379c84711a7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:19.499606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-541e8a77-5fd5-4185-a33d-62059e1e8493 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:19.499906 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1dc1fa13-2f81-4158-8643-8379c84711a7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:19.500088 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-541e8a77-5fd5-4185-a33d-62059e1e8493 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:19.500620 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-541e8a77-5fd5-4185-a33d-62059e1e8493 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:19.501036 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1dc1fa13-2f81-4158-8643-8379c84711a7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:19.503537 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1dc1fa13-2f81-4158-8643-8379c84711a7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:19.504061 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1dc1fa13-2f81-4158-8643-8379c84711a7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:19.691625 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-541e8a77-5fd5-4185-a33d-62059e1e8493 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:19.699942 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-541e8a77-5fd5-4185-a33d-62059e1e8493 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.216292 Sep 02 05:34:19.700294 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1dc1fa13-2f81-4158-8643-8379c84711a7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:19.700589 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 629/1260] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:19 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:19.708151 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-1dc1fa13-2f81-4158-8643-8379c84711a7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.222343 Sep 02 05:34:19.708711 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 632/1261] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:19 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:19.962012 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f1764e24-78a9-4525-8c4d-ba11353c64d6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:19.963050 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f1764e24-78a9-4525-8c4d-ba11353c64d6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:19.972437 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f1764e24-78a9-4525-8c4d-ba11353c64d6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:19.972917 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f1764e24-78a9-4525-8c4d-ba11353c64d6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:19.973349 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f1764e24-78a9-4525-8c4d-ba11353c64d6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:19.974029 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f1764e24-78a9-4525-8c4d-ba11353c64d6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:19.974485 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f1764e24-78a9-4525-8c4d-ba11353c64d6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:19.974903 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f1764e24-78a9-4525-8c4d-ba11353c64d6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:20.116828 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f1764e24-78a9-4525-8c4d-ba11353c64d6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:20.130004 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f1764e24-78a9-4525-8c4d-ba11353c64d6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:20.132263 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f1764e24-78a9-4525-8c4d-ba11353c64d6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:20.134007 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f1764e24-78a9-4525-8c4d-ba11353c64d6 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1729 microversion: 2.20 time: 0.178369 Sep 02 05:34:20.134747 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 630/1262] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:34:19 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:34:20.723476 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-265de8ec-1a46-4695-8323-cffca63c6e4b tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:20.724071 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-265de8ec-1a46-4695-8323-cffca63c6e4b tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:20.728450 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-51d69dfb-8b22-41d8-b545-703427f4a161 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:20.729032 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-51d69dfb-8b22-41d8-b545-703427f4a161 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:20.731012 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-265de8ec-1a46-4695-8323-cffca63c6e4b tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:20.731497 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-265de8ec-1a46-4695-8323-cffca63c6e4b tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:20.731933 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-265de8ec-1a46-4695-8323-cffca63c6e4b tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:20.732659 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-265de8ec-1a46-4695-8323-cffca63c6e4b tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:20.733113 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-265de8ec-1a46-4695-8323-cffca63c6e4b tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:20.733537 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-265de8ec-1a46-4695-8323-cffca63c6e4b tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:20.735991 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-51d69dfb-8b22-41d8-b545-703427f4a161 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:20.736523 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-51d69dfb-8b22-41d8-b545-703427f4a161 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:20.736989 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-51d69dfb-8b22-41d8-b545-703427f4a161 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:20.737661 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-51d69dfb-8b22-41d8-b545-703427f4a161 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:20.738105 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-51d69dfb-8b22-41d8-b545-703427f4a161 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:20.738524 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-51d69dfb-8b22-41d8-b545-703427f4a161 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:20.922689 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-265de8ec-1a46-4695-8323-cffca63c6e4b tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:20.926186 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-51d69dfb-8b22-41d8-b545-703427f4a161 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:20.931344 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-265de8ec-1a46-4695-8323-cffca63c6e4b tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.212893 Sep 02 05:34:20.931932 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 633/1263] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:20 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:20.934130 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-51d69dfb-8b22-41d8-b545-703427f4a161 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.209552 Sep 02 05:34:20.934689 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 631/1264] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:20 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:21.162357 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-d5b8877f-916e-4840-a745-58b578ce87b5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:21.163036 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-d5b8877f-916e-4840-a745-58b578ce87b5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:21.169983 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d5b8877f-916e-4840-a745-58b578ce87b5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:21.170522 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d5b8877f-916e-4840-a745-58b578ce87b5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:21.171012 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d5b8877f-916e-4840-a745-58b578ce87b5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:21.171785 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d5b8877f-916e-4840-a745-58b578ce87b5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:21.172396 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d5b8877f-916e-4840-a745-58b578ce87b5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:21.172877 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d5b8877f-916e-4840-a745-58b578ce87b5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:21.311195 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-d5b8877f-916e-4840-a745-58b578ce87b5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:21.319987 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-d5b8877f-916e-4840-a745-58b578ce87b5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:21.321462 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-d5b8877f-916e-4840-a745-58b578ce87b5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:21.322654 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-d5b8877f-916e-4840-a745-58b578ce87b5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1729 microversion: 2.20 time: 0.165340 Sep 02 05:34:21.323220 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 634/1265] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:34:21 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:34:21.955572 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-20dd7554-012d-4be8-838a-a2f0219323f8 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:21.956434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-20dd7554-012d-4be8-838a-a2f0219323f8 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:21.957257 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-15ae9d55-33a6-43d3-ae28-dc25c0d8bc1c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:21.958257 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-15ae9d55-33a6-43d3-ae28-dc25c0d8bc1c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:21.966546 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-20dd7554-012d-4be8-838a-a2f0219323f8 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:21.967309 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-20dd7554-012d-4be8-838a-a2f0219323f8 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:21.968045 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-20dd7554-012d-4be8-838a-a2f0219323f8 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:21.969220 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-20dd7554-012d-4be8-838a-a2f0219323f8 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:21.969486 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-15ae9d55-33a6-43d3-ae28-dc25c0d8bc1c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:21.969965 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-20dd7554-012d-4be8-838a-a2f0219323f8 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:21.970270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-15ae9d55-33a6-43d3-ae28-dc25c0d8bc1c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:21.971159 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-15ae9d55-33a6-43d3-ae28-dc25c0d8bc1c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:21.971541 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-20dd7554-012d-4be8-838a-a2f0219323f8 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:21.971874 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-15ae9d55-33a6-43d3-ae28-dc25c0d8bc1c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:21.972362 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-15ae9d55-33a6-43d3-ae28-dc25c0d8bc1c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:21.972785 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-15ae9d55-33a6-43d3-ae28-dc25c0d8bc1c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:22.160349 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-15ae9d55-33a6-43d3-ae28-dc25c0d8bc1c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:22.163570 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-20dd7554-012d-4be8-838a-a2f0219323f8 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:22.168228 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-15ae9d55-33a6-43d3-ae28-dc25c0d8bc1c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.217237 Sep 02 05:34:22.168782 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 635/1266] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:21 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:22.171323 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-20dd7554-012d-4be8-838a-a2f0219323f8 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.222380 Sep 02 05:34:22.171914 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 632/1267] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:21 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:22.346119 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-e34c7876-86dd-4587-8a73-d9b174631bf1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:22.346628 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-e34c7876-86dd-4587-8a73-d9b174631bf1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:22.352960 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e34c7876-86dd-4587-8a73-d9b174631bf1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:22.353450 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e34c7876-86dd-4587-8a73-d9b174631bf1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:22.353881 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e34c7876-86dd-4587-8a73-d9b174631bf1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:22.354557 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e34c7876-86dd-4587-8a73-d9b174631bf1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:22.355000 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e34c7876-86dd-4587-8a73-d9b174631bf1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:22.355402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e34c7876-86dd-4587-8a73-d9b174631bf1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:22.494480 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e34c7876-86dd-4587-8a73-d9b174631bf1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:22.507258 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e34c7876-86dd-4587-8a73-d9b174631bf1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:22.509536 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e34c7876-86dd-4587-8a73-d9b174631bf1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:22.511359 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-e34c7876-86dd-4587-8a73-d9b174631bf1 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1729 microversion: 2.20 time: 0.168991 Sep 02 05:34:22.512228 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 636/1268] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:34:22 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:34:23.189956 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-6fa78366-755d-4aea-a601-f5b444d17cbf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:23.190558 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-6fa78366-755d-4aea-a601-f5b444d17cbf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:23.193007 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-24c4f0b4-050a-4a8f-a829-44c4452d1844 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:23.193629 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-24c4f0b4-050a-4a8f-a829-44c4452d1844 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:23.197076 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6fa78366-755d-4aea-a601-f5b444d17cbf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:23.197547 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6fa78366-755d-4aea-a601-f5b444d17cbf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:23.197973 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6fa78366-755d-4aea-a601-f5b444d17cbf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:23.198677 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6fa78366-755d-4aea-a601-f5b444d17cbf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:23.199119 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6fa78366-755d-4aea-a601-f5b444d17cbf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:23.199531 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6fa78366-755d-4aea-a601-f5b444d17cbf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:23.200546 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-24c4f0b4-050a-4a8f-a829-44c4452d1844 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:23.201031 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-24c4f0b4-050a-4a8f-a829-44c4452d1844 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:23.201467 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-24c4f0b4-050a-4a8f-a829-44c4452d1844 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:23.202380 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-24c4f0b4-050a-4a8f-a829-44c4452d1844 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:23.202837 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-24c4f0b4-050a-4a8f-a829-44c4452d1844 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:23.203263 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-24c4f0b4-050a-4a8f-a829-44c4452d1844 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:23.389847 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-6fa78366-755d-4aea-a601-f5b444d17cbf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:23.392918 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-24c4f0b4-050a-4a8f-a829-44c4452d1844 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:23.397947 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-6fa78366-755d-4aea-a601-f5b444d17cbf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1363 microversion: 2.1 time: 0.211989 Sep 02 05:34:23.398522 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 633/1269] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:23 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:23.401176 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-24c4f0b4-050a-4a8f-a829-44c4452d1844 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.211936 Sep 02 05:34:23.401713 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 637/1270] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:23 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:34:23.545512 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-8588eb52-f128-4407-840c-1ba1eb7720e9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:23.546374 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-8588eb52-f128-4407-840c-1ba1eb7720e9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:23.556453 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8588eb52-f128-4407-840c-1ba1eb7720e9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:23.557285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8588eb52-f128-4407-840c-1ba1eb7720e9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:23.557974 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8588eb52-f128-4407-840c-1ba1eb7720e9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:23.559107 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8588eb52-f128-4407-840c-1ba1eb7720e9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:23.559848 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8588eb52-f128-4407-840c-1ba1eb7720e9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:23.560566 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8588eb52-f128-4407-840c-1ba1eb7720e9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:23.701886 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-8588eb52-f128-4407-840c-1ba1eb7720e9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:23.714502 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-8588eb52-f128-4407-840c-1ba1eb7720e9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:23.716360 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-8588eb52-f128-4407-840c-1ba1eb7720e9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:23.717518 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-8588eb52-f128-4407-840c-1ba1eb7720e9 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1729 microversion: 2.20 time: 0.178612 Sep 02 05:34:23.718078 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 634/1271] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:34:23 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:34:24.421157 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-460ab8ad-4759-4a83-93c7-0a532ff06f8e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:24.421731 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-460ab8ad-4759-4a83-93c7-0a532ff06f8e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:24.424209 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-a3536c43-efc5-4612-96ab-c99328273fd6 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:24.425403 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-a3536c43-efc5-4612-96ab-c99328273fd6 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:24.429330 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-460ab8ad-4759-4a83-93c7-0a532ff06f8e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:24.430587 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-460ab8ad-4759-4a83-93c7-0a532ff06f8e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:24.431265 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-460ab8ad-4759-4a83-93c7-0a532ff06f8e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:24.432505 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-460ab8ad-4759-4a83-93c7-0a532ff06f8e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:24.432784 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a3536c43-efc5-4612-96ab-c99328273fd6 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:24.433304 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a3536c43-efc5-4612-96ab-c99328273fd6 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:24.433733 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a3536c43-efc5-4612-96ab-c99328273fd6 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:24.434159 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-460ab8ad-4759-4a83-93c7-0a532ff06f8e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:24.434422 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a3536c43-efc5-4612-96ab-c99328273fd6 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:24.434868 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a3536c43-efc5-4612-96ab-c99328273fd6 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:24.435288 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a3536c43-efc5-4612-96ab-c99328273fd6 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:24.435483 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-460ab8ad-4759-4a83-93c7-0a532ff06f8e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:24.630507 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-a3536c43-efc5-4612-96ab-c99328273fd6 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:24.633572 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-460ab8ad-4759-4a83-93c7-0a532ff06f8e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:24.638546 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-a3536c43-efc5-4612-96ab-c99328273fd6 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.218535 Sep 02 05:34:24.639265 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 635/1272] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:24 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:34:24.641599 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-460ab8ad-4759-4a83-93c7-0a532ff06f8e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1548 microversion: 2.1 time: 0.224352 Sep 02 05:34:24.642175 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 638/1273] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:24 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1548 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:24.662003 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-54f63e9a-de16-4405-8122-9fa05a70355d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:24.662505 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-54f63e9a-de16-4405-8122-9fa05a70355d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:24.668569 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-54f63e9a-de16-4405-8122-9fa05a70355d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:24.669037 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-54f63e9a-de16-4405-8122-9fa05a70355d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:24.669461 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-54f63e9a-de16-4405-8122-9fa05a70355d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:24.670138 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-54f63e9a-de16-4405-8122-9fa05a70355d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:24.670583 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-54f63e9a-de16-4405-8122-9fa05a70355d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:24.670995 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-54f63e9a-de16-4405-8122-9fa05a70355d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:24.741218 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-3333016b-d980-4b97-a981-514782831c6d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:24.741919 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-3333016b-d980-4b97-a981-514782831c6d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:24.748147 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3333016b-d980-4b97-a981-514782831c6d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:24.748893 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3333016b-d980-4b97-a981-514782831c6d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:24.749075 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3333016b-d980-4b97-a981-514782831c6d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:24.749777 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3333016b-d980-4b97-a981-514782831c6d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:24.750258 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3333016b-d980-4b97-a981-514782831c6d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:24.750757 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3333016b-d980-4b97-a981-514782831c6d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:24.753026 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-54f63e9a-de16-4405-8122-9fa05a70355d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094437 Sep 02 05:34:24.753824 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 636/1274] 10.222.0.30 () {58 vars in 1275 bytes} [Fri Sep 2 05:34:24 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:34:24.886434 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-3333016b-d980-4b97-a981-514782831c6d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:24.896384 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-3333016b-d980-4b97-a981-514782831c6d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:24.897848 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-3333016b-d980-4b97-a981-514782831c6d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:24.899022 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-3333016b-d980-4b97-a981-514782831c6d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1729 microversion: 2.20 time: 0.161871 Sep 02 05:34:24.907192 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 639/1275] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:34:24 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:34:25.659713 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-7d7afb5f-2c34-43de-bacf-bf1a1475f9e9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:25.660558 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-7d7afb5f-2c34-43de-bacf-bf1a1475f9e9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:25.666718 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7d7afb5f-2c34-43de-bacf-bf1a1475f9e9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:25.667204 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7d7afb5f-2c34-43de-bacf-bf1a1475f9e9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:25.667634 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7d7afb5f-2c34-43de-bacf-bf1a1475f9e9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:25.668364 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7d7afb5f-2c34-43de-bacf-bf1a1475f9e9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:25.668811 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7d7afb5f-2c34-43de-bacf-bf1a1475f9e9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:25.669232 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7d7afb5f-2c34-43de-bacf-bf1a1475f9e9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:25.803835 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-f5631f3c-50e8-4914-8fa4-b7a95c9d7abd req-0af5a420-752a-4e4d-8edc-b2762daf4d6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d19306c3-935d-4876-9adb-651da56d0574", "tag": "e83b7424-9d82-42cb-813a-c872cb5208ac"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:34:25.815944 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-f5631f3c-50e8-4914-8fa4-b7a95c9d7abd req-0af5a420-752a-4e4d-8edc-b2762daf4d6c service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:25.816465 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-f5631f3c-50e8-4914-8fa4-b7a95c9d7abd req-0af5a420-752a-4e4d-8edc-b2762daf4d6c service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:25.816895 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-f5631f3c-50e8-4914-8fa4-b7a95c9d7abd req-0af5a420-752a-4e4d-8edc-b2762daf4d6c service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:25.821404 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-7d7afb5f-2c34-43de-bacf-bf1a1475f9e9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:25.829893 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-7d7afb5f-2c34-43de-bacf-bf1a1475f9e9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.174651 Sep 02 05:34:25.830867 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 637/1276] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:25 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:25.832186 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-f5631f3c-50e8-4914-8fa4-b7a95c9d7abd req-0af5a420-752a-4e4d-8edc-b2762daf4d6c service nova] Creating event network-changed:e83b7424-9d82-42cb-813a-c872cb5208ac for instance d19306c3-935d-4876-9adb-651da56d0574 on hv-cinder-85391 Sep 02 05:34:25.837895 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-f5631f3c-50e8-4914-8fa4-b7a95c9d7abd req-0af5a420-752a-4e4d-8edc-b2762daf4d6c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038034 Sep 02 05:34:25.838482 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 640/1277] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:34:25.922542 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-fbff5cb2-7f96-4f47-9626-357f0046b156 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:25.923158 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-fbff5cb2-7f96-4f47-9626-357f0046b156 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:25.929410 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fbff5cb2-7f96-4f47-9626-357f0046b156 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:25.929989 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fbff5cb2-7f96-4f47-9626-357f0046b156 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:25.930511 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fbff5cb2-7f96-4f47-9626-357f0046b156 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:25.931271 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fbff5cb2-7f96-4f47-9626-357f0046b156 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:25.931722 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fbff5cb2-7f96-4f47-9626-357f0046b156 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:25.932229 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fbff5cb2-7f96-4f47-9626-357f0046b156 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:26.074159 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-fbff5cb2-7f96-4f47-9626-357f0046b156 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:26.083216 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-fbff5cb2-7f96-4f47-9626-357f0046b156 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:26.084660 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-fbff5cb2-7f96-4f47-9626-357f0046b156 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:26.086050 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-fbff5cb2-7f96-4f47-9626-357f0046b156 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1729 microversion: 2.20 time: 0.167540 Sep 02 05:34:26.086610 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 638/1278] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:34:25 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:34:26.852078 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-910e29ea-773b-4ed7-b01e-9fa47d4f4e8e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:26.852815 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-910e29ea-773b-4ed7-b01e-9fa47d4f4e8e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:26.859449 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-910e29ea-773b-4ed7-b01e-9fa47d4f4e8e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:26.859934 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-910e29ea-773b-4ed7-b01e-9fa47d4f4e8e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:26.860506 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-910e29ea-773b-4ed7-b01e-9fa47d4f4e8e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:26.861564 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-910e29ea-773b-4ed7-b01e-9fa47d4f4e8e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:26.861987 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-910e29ea-773b-4ed7-b01e-9fa47d4f4e8e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:26.862503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-910e29ea-773b-4ed7-b01e-9fa47d4f4e8e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:26.998917 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-910e29ea-773b-4ed7-b01e-9fa47d4f4e8e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:27.006856 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-910e29ea-773b-4ed7-b01e-9fa47d4f4e8e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1357 microversion: 2.1 time: 0.159568 Sep 02 05:34:27.007539 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 641/1279] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:26 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:27.109945 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-b6c4ff95-de50-4a82-ad28-86570aad6f3f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:27.111304 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-b6c4ff95-de50-4a82-ad28-86570aad6f3f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:27.114753 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=80 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:27.123587 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b6c4ff95-de50-4a82-ad28-86570aad6f3f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:27.123587 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b6c4ff95-de50-4a82-ad28-86570aad6f3f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:27.123587 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b6c4ff95-de50-4a82-ad28-86570aad6f3f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:27.123587 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b6c4ff95-de50-4a82-ad28-86570aad6f3f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:27.126079 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b6c4ff95-de50-4a82-ad28-86570aad6f3f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:27.126079 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b6c4ff95-de50-4a82-ad28-86570aad6f3f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:27.284667 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-b6c4ff95-de50-4a82-ad28-86570aad6f3f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:27.293118 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-b6c4ff95-de50-4a82-ad28-86570aad6f3f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:27.294534 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-b6c4ff95-de50-4a82-ad28-86570aad6f3f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:27.295714 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-b6c4ff95-de50-4a82-ad28-86570aad6f3f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1729 microversion: 2.20 time: 0.190581 Sep 02 05:34:27.296308 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 639/1280] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:34:27 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:34:27.949335 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-58fe2b0c-3789-4039-819c-6ed35d6b5451 req-de1278f1-5421-4118-b60b-0d9066cdfd16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d862d87f-85bc-4970-97b5-af0ff1b6ebf8", "name": "network-vif-plugged", "status": "completed", "tag": "47f28e65-04e5-4573-84d6-9faa45a85dd1"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:34:27.959662 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-58fe2b0c-3789-4039-819c-6ed35d6b5451 req-de1278f1-5421-4118-b60b-0d9066cdfd16 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:27.960199 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-58fe2b0c-3789-4039-819c-6ed35d6b5451 req-de1278f1-5421-4118-b60b-0d9066cdfd16 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:27.960646 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-58fe2b0c-3789-4039-819c-6ed35d6b5451 req-de1278f1-5421-4118-b60b-0d9066cdfd16 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:27.975697 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-58fe2b0c-3789-4039-819c-6ed35d6b5451 req-de1278f1-5421-4118-b60b-0d9066cdfd16 service nova] Creating event network-vif-plugged:47f28e65-04e5-4573-84d6-9faa45a85dd1 for instance d862d87f-85bc-4970-97b5-af0ff1b6ebf8 on hv-cinder-85391 Sep 02 05:34:27.980717 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-58fe2b0c-3789-4039-819c-6ed35d6b5451 req-de1278f1-5421-4118-b60b-0d9066cdfd16 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036348 Sep 02 05:34:27.981888 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 642/1281] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:34:28.026787 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-98ac2c0f-8723-49e8-8f13-9f6ce8b240e8 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:28.027448 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-98ac2c0f-8723-49e8-8f13-9f6ce8b240e8 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:28.033747 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-98ac2c0f-8723-49e8-8f13-9f6ce8b240e8 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:28.034220 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-98ac2c0f-8723-49e8-8f13-9f6ce8b240e8 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:28.034750 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-98ac2c0f-8723-49e8-8f13-9f6ce8b240e8 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:28.035425 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-98ac2c0f-8723-49e8-8f13-9f6ce8b240e8 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:28.035866 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-98ac2c0f-8723-49e8-8f13-9f6ce8b240e8 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:28.036326 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-98ac2c0f-8723-49e8-8f13-9f6ce8b240e8 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:28.172478 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-98ac2c0f-8723-49e8-8f13-9f6ce8b240e8 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:28.180215 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-98ac2c0f-8723-49e8-8f13-9f6ce8b240e8 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1548 microversion: 2.1 time: 0.157250 Sep 02 05:34:28.181014 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 640/1282] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:28 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:28.201263 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-7791f159-4f02-4143-94cc-815502a0c200 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:28.201962 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-7791f159-4f02-4143-94cc-815502a0c200 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:28.208293 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7791f159-4f02-4143-94cc-815502a0c200 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:28.208713 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7791f159-4f02-4143-94cc-815502a0c200 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:28.209145 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7791f159-4f02-4143-94cc-815502a0c200 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:28.209835 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7791f159-4f02-4143-94cc-815502a0c200 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:28.210284 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7791f159-4f02-4143-94cc-815502a0c200 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:28.210704 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7791f159-4f02-4143-94cc-815502a0c200 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:28.318088 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-781a0ec5-c2ea-4e4e-a5bb-20a4596e1300 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:28.318866 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-781a0ec5-c2ea-4e4e-a5bb-20a4596e1300 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:28.324959 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-781a0ec5-c2ea-4e4e-a5bb-20a4596e1300 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:28.325518 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-781a0ec5-c2ea-4e4e-a5bb-20a4596e1300 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:28.326005 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-781a0ec5-c2ea-4e4e-a5bb-20a4596e1300 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:28.326746 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-781a0ec5-c2ea-4e4e-a5bb-20a4596e1300 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:28.327255 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-781a0ec5-c2ea-4e4e-a5bb-20a4596e1300 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:28.327732 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-781a0ec5-c2ea-4e4e-a5bb-20a4596e1300 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:28.340262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-7791f159-4f02-4143-94cc-815502a0c200 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:28.347905 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-7791f159-4f02-4143-94cc-815502a0c200 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1548 microversion: 2.1 time: 0.150863 Sep 02 05:34:28.348542 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 643/1283] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:28 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:28.367566 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-8960a661-049e-492a-987f-f23893f9a7fa tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:28.372351 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-8960a661-049e-492a-987f-f23893f9a7fa tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:28.373144 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-8960a661-049e-492a-987f-f23893f9a7fa tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Searching by: {'deleted': False, 'project_id': '4f5094f4d0894667b1d725d84b220858'} {{(pid=120449) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 02 05:34:28.379795 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8960a661-049e-492a-987f-f23893f9a7fa tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:28.380320 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8960a661-049e-492a-987f-f23893f9a7fa tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:28.380757 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8960a661-049e-492a-987f-f23893f9a7fa tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:28.381469 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8960a661-049e-492a-987f-f23893f9a7fa tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:28.381915 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8960a661-049e-492a-987f-f23893f9a7fa tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:28.382328 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8960a661-049e-492a-987f-f23893f9a7fa tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:28.458089 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-781a0ec5-c2ea-4e4e-a5bb-20a4596e1300 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:28.466589 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-781a0ec5-c2ea-4e4e-a5bb-20a4596e1300 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:28.468410 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-781a0ec5-c2ea-4e4e-a5bb-20a4596e1300 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:28.469183 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-781a0ec5-c2ea-4e4e-a5bb-20a4596e1300 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1729 microversion: 2.20 time: 0.155040 Sep 02 05:34:28.469715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 641/1284] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:34:28 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 05:34:28.474513 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.multi_cell_list [None req-8960a661-049e-492a-987f-f23893f9a7fa tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120449) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 02 05:34:28.567575 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-8960a661-049e-492a-987f-f23893f9a7fa tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.203522 Sep 02 05:34:28.568167 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 644/1285] 10.222.0.30 () {58 vars in 1125 bytes} [Fri Sep 2 05:34:28 2022] GET /compute/v2.1/servers => generated 342 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 05:34:28.579644 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-b8e2107c-986b-4b21-8cb7-63d74a27c762 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:28.580297 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-b8e2107c-986b-4b21-8cb7-63d74a27c762 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:28.586703 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b8e2107c-986b-4b21-8cb7-63d74a27c762 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:28.587316 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b8e2107c-986b-4b21-8cb7-63d74a27c762 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:28.587780 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b8e2107c-986b-4b21-8cb7-63d74a27c762 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:28.588519 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b8e2107c-986b-4b21-8cb7-63d74a27c762 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:28.588937 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b8e2107c-986b-4b21-8cb7-63d74a27c762 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:28.589386 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b8e2107c-986b-4b21-8cb7-63d74a27c762 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:28.725089 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-b8e2107c-986b-4b21-8cb7-63d74a27c762 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:28.733548 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-b8e2107c-986b-4b21-8cb7-63d74a27c762 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1548 microversion: 2.1 time: 0.157822 Sep 02 05:34:28.734172 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 642/1286] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:28 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:29.493148 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-e5d5005c-0dcf-4ad9-85a1-d1bf3ce4863e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:29.493730 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-e5d5005c-0dcf-4ad9-85a1-d1bf3ce4863e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:29.496314 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_api:SELECT=80 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:29.502034 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e5d5005c-0dcf-4ad9-85a1-d1bf3ce4863e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:29.502518 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e5d5005c-0dcf-4ad9-85a1-d1bf3ce4863e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:29.502930 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e5d5005c-0dcf-4ad9-85a1-d1bf3ce4863e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:29.503723 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e5d5005c-0dcf-4ad9-85a1-d1bf3ce4863e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:29.504158 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e5d5005c-0dcf-4ad9-85a1-d1bf3ce4863e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:29.504596 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e5d5005c-0dcf-4ad9-85a1-d1bf3ce4863e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:29.650370 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e5d5005c-0dcf-4ad9-85a1-d1bf3ce4863e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:29.652591 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=100 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:29.660004 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e5d5005c-0dcf-4ad9-85a1-d1bf3ce4863e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:29.661519 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e5d5005c-0dcf-4ad9-85a1-d1bf3ce4863e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:29.662695 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-e5d5005c-0dcf-4ad9-85a1-d1bf3ce4863e tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1729 microversion: 2.20 time: 0.173655 Sep 02 05:34:29.663260 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 645/1287] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:34:29 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:34:30.306040 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-67f6f189-4d21-42ce-8e0f-96dafccd9d46 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2820ea98-0cc6-4750-8556-17aca758c2a7"}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:34:30.308747 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-67f6f189-4d21-42ce-8e0f-96dafccd9d46 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:30.315661 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-67f6f189-4d21-42ce-8e0f-96dafccd9d46 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:30.316151 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-67f6f189-4d21-42ce-8e0f-96dafccd9d46 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:30.316602 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-67f6f189-4d21-42ce-8e0f-96dafccd9d46 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:30.317395 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-67f6f189-4d21-42ce-8e0f-96dafccd9d46 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:30.317841 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-67f6f189-4d21-42ce-8e0f-96dafccd9d46 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:30.318256 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-67f6f189-4d21-42ce-8e0f-96dafccd9d46 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:30.581336 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:30.606381 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-67f6f189-4d21-42ce-8e0f-96dafccd9d46 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "POST /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304395 Sep 02 05:34:30.607049 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 643/1288] 10.222.0.30 () {60 vars in 1323 bytes} [Fri Sep 2 05:34:30 2022] POST /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:34:30.685482 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-d63247d4-dd6f-4e20-8f10-56511f5d268f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:30.686104 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-d63247d4-dd6f-4e20-8f10-56511f5d268f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:30.694251 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d63247d4-dd6f-4e20-8f10-56511f5d268f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:30.694938 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d63247d4-dd6f-4e20-8f10-56511f5d268f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:30.695570 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d63247d4-dd6f-4e20-8f10-56511f5d268f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:30.696403 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d63247d4-dd6f-4e20-8f10-56511f5d268f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:30.696863 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d63247d4-dd6f-4e20-8f10-56511f5d268f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:30.697286 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d63247d4-dd6f-4e20-8f10-56511f5d268f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:30.838566 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-d63247d4-dd6f-4e20-8f10-56511f5d268f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:30.848647 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-d63247d4-dd6f-4e20-8f10-56511f5d268f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:30.850378 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-d63247d4-dd6f-4e20-8f10-56511f5d268f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:30.851623 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-d63247d4-dd6f-4e20-8f10-56511f5d268f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1729 microversion: 2.20 time: 0.170134 Sep 02 05:34:30.852291 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 646/1289] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:34:30 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:34:31.880768 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-2d0d95ba-ed20-4dd7-9806-3f8dfd0f15b0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:31.881498 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-2d0d95ba-ed20-4dd7-9806-3f8dfd0f15b0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:31.888470 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2d0d95ba-ed20-4dd7-9806-3f8dfd0f15b0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:31.888953 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2d0d95ba-ed20-4dd7-9806-3f8dfd0f15b0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:31.889390 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2d0d95ba-ed20-4dd7-9806-3f8dfd0f15b0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:31.890082 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2d0d95ba-ed20-4dd7-9806-3f8dfd0f15b0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:31.890545 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2d0d95ba-ed20-4dd7-9806-3f8dfd0f15b0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:31.890969 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2d0d95ba-ed20-4dd7-9806-3f8dfd0f15b0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:32.027937 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-2d0d95ba-ed20-4dd7-9806-3f8dfd0f15b0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:32.036548 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-2d0d95ba-ed20-4dd7-9806-3f8dfd0f15b0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:32.037992 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-2d0d95ba-ed20-4dd7-9806-3f8dfd0f15b0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:32.039148 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-2d0d95ba-ed20-4dd7-9806-3f8dfd0f15b0 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1716 microversion: 2.20 time: 0.166212 Sep 02 05:34:32.039714 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 644/1290] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:34:31 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1716 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:34:38.266674 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-6ed30702-1405-42be-8148-d9199a8150b4 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:38.267240 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-6ed30702-1405-42be-8148-d9199a8150b4 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:38.274365 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6ed30702-1405-42be-8148-d9199a8150b4 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:38.274847 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6ed30702-1405-42be-8148-d9199a8150b4 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:38.275250 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6ed30702-1405-42be-8148-d9199a8150b4 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:38.275933 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6ed30702-1405-42be-8148-d9199a8150b4 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:38.276412 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6ed30702-1405-42be-8148-d9199a8150b4 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:38.276834 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6ed30702-1405-42be-8148-d9199a8150b4 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:38.409067 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-6ed30702-1405-42be-8148-d9199a8150b4 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:38.412722 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell0:SELECT=2 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:38.418549 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-6ed30702-1405-42be-8148-d9199a8150b4 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1594 microversion: 2.1 time: 0.155777 Sep 02 05:34:38.419086 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 647/1291] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:38 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1594 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:40.447543 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-6cfc48f0-3158-4e05-b98f-2a04df396808 req-896f7a8a-afbb-4b23-ba2d-a4cd2df1d757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1051c26e-620c-419e-8b92-69c6a09b79ba", "tag": "45c24232-6095-4cd2-8644-d456619c27ed"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:34:40.457662 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-6cfc48f0-3158-4e05-b98f-2a04df396808 req-896f7a8a-afbb-4b23-ba2d-a4cd2df1d757 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:40.458176 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-6cfc48f0-3158-4e05-b98f-2a04df396808 req-896f7a8a-afbb-4b23-ba2d-a4cd2df1d757 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:40.458613 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-6cfc48f0-3158-4e05-b98f-2a04df396808 req-896f7a8a-afbb-4b23-ba2d-a4cd2df1d757 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:40.471795 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-6cfc48f0-3158-4e05-b98f-2a04df396808 req-896f7a8a-afbb-4b23-ba2d-a4cd2df1d757 service nova] Creating event network-changed:45c24232-6095-4cd2-8644-d456619c27ed for instance 1051c26e-620c-419e-8b92-69c6a09b79ba on hv-cinder-85391 Sep 02 05:34:40.476980 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-6cfc48f0-3158-4e05-b98f-2a04df396808 req-896f7a8a-afbb-4b23-ba2d-a4cd2df1d757 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100083 Sep 02 05:34:40.477591 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 645/1292] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:34:41.521987 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ae673a3b-1e2f-443a-8101-79dfd967d9cb tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1775816835"}} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:34:41.522553 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-ae673a3b-1e2f-443a-8101-79dfd967d9cb tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:41.529396 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ae673a3b-1e2f-443a-8101-79dfd967d9cb tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:41.529910 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ae673a3b-1e2f-443a-8101-79dfd967d9cb tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:41.530328 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ae673a3b-1e2f-443a-8101-79dfd967d9cb tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:41.531030 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ae673a3b-1e2f-443a-8101-79dfd967d9cb tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:41.531486 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ae673a3b-1e2f-443a-8101-79dfd967d9cb tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:41.531913 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ae673a3b-1e2f-443a-8101-79dfd967d9cb tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:41.668044 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.network.security_group_api [None req-ae673a3b-1e2f-443a-8101-79dfd967d9cb tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Adding security group d520822f-098e-478c-9efa-90513790d68f to port 45c24232-6095-4cd2-8644-d456619c27ed Sep 02 05:34:42.007333 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-ae673a3b-1e2f-443a-8101-79dfd967d9cb tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "POST /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba/action" status: 202 len: 0 microversion: 2.1 time: 0.489466 Sep 02 05:34:42.008166 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 648/1293] 10.222.0.30 () {60 vars in 1278 bytes} [Fri Sep 2 05:34:41 2022] POST /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:34:42.017415 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-6c6ce350-7026-491e-8a92-bbf7cfcd8c39 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:34:42.018701 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-6c6ce350-7026-491e-8a92-bbf7cfcd8c39 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:34:42.025041 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6c6ce350-7026-491e-8a92-bbf7cfcd8c39 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:42.025519 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6c6ce350-7026-491e-8a92-bbf7cfcd8c39 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:42.025953 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6c6ce350-7026-491e-8a92-bbf7cfcd8c39 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:42.026649 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6c6ce350-7026-491e-8a92-bbf7cfcd8c39 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:42.027095 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6c6ce350-7026-491e-8a92-bbf7cfcd8c39 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:42.027517 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6c6ce350-7026-491e-8a92-bbf7cfcd8c39 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:42.182411 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-6c6ce350-7026-491e-8a92-bbf7cfcd8c39 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:34:42.191190 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-6c6ce350-7026-491e-8a92-bbf7cfcd8c39 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1758 microversion: 2.1 time: 0.178465 Sep 02 05:34:42.191833 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 646/1294] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:34:42 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:34:42.493433 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-78ac90a2-9529-4331-b6b5-59c6ab478f8e req-33b4c61b-3753-472f-987f-6b142b8e4f6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1051c26e-620c-419e-8b92-69c6a09b79ba", "tag": "45c24232-6095-4cd2-8644-d456619c27ed"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:34:42.503133 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-78ac90a2-9529-4331-b6b5-59c6ab478f8e req-33b4c61b-3753-472f-987f-6b142b8e4f6e service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:34:42.503607 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-78ac90a2-9529-4331-b6b5-59c6ab478f8e req-33b4c61b-3753-472f-987f-6b142b8e4f6e service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:34:42.504035 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-78ac90a2-9529-4331-b6b5-59c6ab478f8e req-33b4c61b-3753-472f-987f-6b142b8e4f6e service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:34:42.515065 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-78ac90a2-9529-4331-b6b5-59c6ab478f8e req-33b4c61b-3753-472f-987f-6b142b8e4f6e service nova] Creating event network-changed:45c24232-6095-4cd2-8644-d456619c27ed for instance 1051c26e-620c-419e-8b92-69c6a09b79ba on hv-cinder-85391 Sep 02 05:34:42.520474 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-78ac90a2-9529-4331-b6b5-59c6ab478f8e req-33b4c61b-3753-472f-987f-6b142b8e4f6e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030552 Sep 02 05:34:42.520968 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 649/1295] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:35:15.740849 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f426ff38-6394-4432-b715-bc64b5f05fd2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:35:15.741447 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f426ff38-6394-4432-b715-bc64b5f05fd2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 47d13255-9c47-4bba-a83c-1bba0adb6276] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:35:15.743420 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=15 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:35:15.744073 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=16,nova_cell1:INSERT=1 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:35:15.744837 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 05:35:15.744996 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Fri Sep 2 05:35:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276/ips (ip 10.222.0.30) !!! Sep 02 05:35:15.752885 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f426ff38-6394-4432-b715-bc64b5f05fd2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:15.753350 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f426ff38-6394-4432-b715-bc64b5f05fd2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:15.753782 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f426ff38-6394-4432-b715-bc64b5f05fd2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:15.754482 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f426ff38-6394-4432-b715-bc64b5f05fd2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:15.755030 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f426ff38-6394-4432-b715-bc64b5f05fd2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:15.755455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f426ff38-6394-4432-b715-bc64b5f05fd2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:15.779999 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f426ff38-6394-4432-b715-bc64b5f05fd2 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276/ips" status: 200 len: 149 microversion: 2.1 time: 0.043545 Sep 02 05:35:15.780580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 647/1296] 10.222.0.30 () {58 vars in 1248 bytes} [Fri Sep 2 05:35:15 2022] GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:35:18.188107 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-6eee1c6f-78b9-45e6-8c2c-9dedab18275b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fea6ab5a-b06d-4743-af57-48fbdbfe97ed"}} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:35:18.190560 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-6eee1c6f-78b9-45e6-8c2c-9dedab18275b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 47d13255-9c47-4bba-a83c-1bba0adb6276] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:35:18.192877 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_api:SELECT=9 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:35:18.193528 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=19 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:35:18.200247 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6eee1c6f-78b9-45e6-8c2c-9dedab18275b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:18.200729 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6eee1c6f-78b9-45e6-8c2c-9dedab18275b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:18.201160 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6eee1c6f-78b9-45e6-8c2c-9dedab18275b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:18.201846 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6eee1c6f-78b9-45e6-8c2c-9dedab18275b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:18.202288 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6eee1c6f-78b9-45e6-8c2c-9dedab18275b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:18.202698 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6eee1c6f-78b9-45e6-8c2c-9dedab18275b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:18.486829 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-6eee1c6f-78b9-45e6-8c2c-9dedab18275b tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "POST /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302615 Sep 02 05:35:18.487469 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 650/1297] 10.222.0.30 () {60 vars in 1323 bytes} [Fri Sep 2 05:35:18 2022] POST /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:35:26.366094 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f0c0336d-8650-4ad4-b9f7-b38ab99abd78 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:35:26.366698 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f0c0336d-8650-4ad4-b9f7-b38ab99abd78 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 47d13255-9c47-4bba-a83c-1bba0adb6276] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:35:26.369075 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=2 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:35:26.369739 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=4 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:35:26.375682 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f0c0336d-8650-4ad4-b9f7-b38ab99abd78 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:26.376096 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f0c0336d-8650-4ad4-b9f7-b38ab99abd78 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:26.376553 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f0c0336d-8650-4ad4-b9f7-b38ab99abd78 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:26.377238 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f0c0336d-8650-4ad4-b9f7-b38ab99abd78 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:26.377691 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f0c0336d-8650-4ad4-b9f7-b38ab99abd78 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:26.378112 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f0c0336d-8650-4ad4-b9f7-b38ab99abd78 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:26.472449 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.objects.instance [None req-f0c0336d-8650-4ad4-b9f7-b38ab99abd78 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lazy-loading 'services' on Instance uuid 47d13255-9c47-4bba-a83c-1bba0adb6276 {{(pid=120448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:35:26.575495 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f0c0336d-8650-4ad4-b9f7-b38ab99abd78 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "DELETE /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276/os-volume_attachments/fea6ab5a-b06d-4743-af57-48fbdbfe97ed" status: 202 len: 0 microversion: 2.1 time: 0.213176 Sep 02 05:35:26.576185 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 648/1298] 10.222.0.30 () {58 vars in 1416 bytes} [Fri Sep 2 05:35:26 2022] DELETE /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276/os-volume_attachments/fea6ab5a-b06d-4743-af57-48fbdbfe97ed => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:35:26.586182 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-6f9ed466-60b4-4526-8142-5a6c61169c57 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:35:26.588561 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-6f9ed466-60b4-4526-8142-5a6c61169c57 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 47d13255-9c47-4bba-a83c-1bba0adb6276] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:35:26.595633 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6f9ed466-60b4-4526-8142-5a6c61169c57 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:26.596154 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6f9ed466-60b4-4526-8142-5a6c61169c57 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:26.596637 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6f9ed466-60b4-4526-8142-5a6c61169c57 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:26.597350 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6f9ed466-60b4-4526-8142-5a6c61169c57 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:26.597781 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6f9ed466-60b4-4526-8142-5a6c61169c57 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:26.601410 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6f9ed466-60b4-4526-8142-5a6c61169c57 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:26.632639 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-6f9ed466-60b4-4526-8142-5a6c61169c57 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051336 Sep 02 05:35:26.633084 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 651/1299] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Sep 2 05:35:26 2022] GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:35:27.646176 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-a620c9ae-ec50-4bd8-9775-ba76eacd7bde tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:35:27.648554 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-a620c9ae-ec50-4bd8-9775-ba76eacd7bde tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 47d13255-9c47-4bba-a83c-1bba0adb6276] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:35:27.654930 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a620c9ae-ec50-4bd8-9775-ba76eacd7bde tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:27.655446 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a620c9ae-ec50-4bd8-9775-ba76eacd7bde tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:27.655878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a620c9ae-ec50-4bd8-9775-ba76eacd7bde tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:27.656628 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a620c9ae-ec50-4bd8-9775-ba76eacd7bde tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:27.657069 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a620c9ae-ec50-4bd8-9775-ba76eacd7bde tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:27.657473 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a620c9ae-ec50-4bd8-9775-ba76eacd7bde tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:27.686903 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-a620c9ae-ec50-4bd8-9775-ba76eacd7bde tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045465 Sep 02 05:35:27.687545 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 649/1300] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Sep 2 05:35:27 2022] GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 05:35:27.750377 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-886e121e-48b8-4288-ba99-6e8792cbfc00 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:35:27.750883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-886e121e-48b8-4288-ba99-6e8792cbfc00 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 47d13255-9c47-4bba-a83c-1bba0adb6276] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:35:27.757504 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-886e121e-48b8-4288-ba99-6e8792cbfc00 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:27.758061 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-886e121e-48b8-4288-ba99-6e8792cbfc00 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:27.758490 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-886e121e-48b8-4288-ba99-6e8792cbfc00 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:27.759202 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-886e121e-48b8-4288-ba99-6e8792cbfc00 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:27.759649 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-886e121e-48b8-4288-ba99-6e8792cbfc00 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:27.760099 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-886e121e-48b8-4288-ba99-6e8792cbfc00 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:27.784950 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-886e121e-48b8-4288-ba99-6e8792cbfc00 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 47d13255-9c47-4bba-a83c-1bba0adb6276] Going to try to terminate instance {{(pid=120449) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 05:35:27.870494 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-886e121e-48b8-4288-ba99-6e8792cbfc00 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "DELETE /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276" status: 204 len: 0 microversion: 2.1 time: 0.123566 Sep 02 05:35:27.871178 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 652/1301] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Sep 2 05:35:27 2022] DELETE /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 05:35:27.879953 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-538e3c93-f4d7-4ea0-95f6-0ba606c16dd8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:35:27.880727 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-538e3c93-f4d7-4ea0-95f6-0ba606c16dd8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 47d13255-9c47-4bba-a83c-1bba0adb6276] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:35:27.886961 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-538e3c93-f4d7-4ea0-95f6-0ba606c16dd8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:27.887451 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-538e3c93-f4d7-4ea0-95f6-0ba606c16dd8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:27.887883 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-538e3c93-f4d7-4ea0-95f6-0ba606c16dd8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:27.888606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-538e3c93-f4d7-4ea0-95f6-0ba606c16dd8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:27.889052 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-538e3c93-f4d7-4ea0-95f6-0ba606c16dd8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:27.889472 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-538e3c93-f4d7-4ea0-95f6-0ba606c16dd8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:28.032760 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-538e3c93-f4d7-4ea0-95f6-0ba606c16dd8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:28.044944 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-538e3c93-f4d7-4ea0-95f6-0ba606c16dd8 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276" status: 200 len: 1680 microversion: 2.1 time: 0.168546 Sep 02 05:35:28.046322 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 650/1302] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:35:27 2022] GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:35:29.071886 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-046e5445-f059-477f-b6c9-238037b6d615 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:35:29.072502 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-046e5445-f059-477f-b6c9-238037b6d615 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 47d13255-9c47-4bba-a83c-1bba0adb6276] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:35:29.079691 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-046e5445-f059-477f-b6c9-238037b6d615 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:29.080202 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-046e5445-f059-477f-b6c9-238037b6d615 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:29.080640 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-046e5445-f059-477f-b6c9-238037b6d615 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:29.081330 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-046e5445-f059-477f-b6c9-238037b6d615 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:29.081774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-046e5445-f059-477f-b6c9-238037b6d615 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:29.082184 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-046e5445-f059-477f-b6c9-238037b6d615 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:29.219115 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-046e5445-f059-477f-b6c9-238037b6d615 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:29.226976 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-046e5445-f059-477f-b6c9-238037b6d615 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276" status: 200 len: 1680 microversion: 2.1 time: 0.161736 Sep 02 05:35:29.227555 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 653/1303] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:35:29 2022] GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:35:30.249051 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-cb47c04f-132f-4410-8ec3-19f2282ea3d4 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:35:30.249611 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-cb47c04f-132f-4410-8ec3-19f2282ea3d4 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 47d13255-9c47-4bba-a83c-1bba0adb6276] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:35:30.256425 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cb47c04f-132f-4410-8ec3-19f2282ea3d4 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:30.256906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cb47c04f-132f-4410-8ec3-19f2282ea3d4 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:30.257373 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cb47c04f-132f-4410-8ec3-19f2282ea3d4 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:30.258062 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cb47c04f-132f-4410-8ec3-19f2282ea3d4 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:30.258505 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cb47c04f-132f-4410-8ec3-19f2282ea3d4 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:30.258929 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cb47c04f-132f-4410-8ec3-19f2282ea3d4 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:30.392425 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-cb47c04f-132f-4410-8ec3-19f2282ea3d4 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:30.400558 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-cb47c04f-132f-4410-8ec3-19f2282ea3d4 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276" status: 200 len: 1680 microversion: 2.1 time: 0.155490 Sep 02 05:35:30.401220 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 651/1304] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:35:30 2022] GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:35:30.870458 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-7078f4d4-f26c-4edd-8a99-6011c884a7bf req-9627222e-9b23-4f8d-9654-e0bbf736c1a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47d13255-9c47-4bba-a83c-1bba0adb6276", "name": "network-vif-deleted", "tag": "a616ea50-2a64-424a-bca9-fc3358e11f91"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:35:30.886931 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-7078f4d4-f26c-4edd-8a99-6011c884a7bf req-9627222e-9b23-4f8d-9654-e0bbf736c1a7 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:30.887542 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-7078f4d4-f26c-4edd-8a99-6011c884a7bf req-9627222e-9b23-4f8d-9654-e0bbf736c1a7 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:30.888281 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-7078f4d4-f26c-4edd-8a99-6011c884a7bf req-9627222e-9b23-4f8d-9654-e0bbf736c1a7 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:30.900892 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-7078f4d4-f26c-4edd-8a99-6011c884a7bf req-9627222e-9b23-4f8d-9654-e0bbf736c1a7 service nova] Creating event network-vif-deleted:a616ea50-2a64-424a-bca9-fc3358e11f91 for instance 47d13255-9c47-4bba-a83c-1bba0adb6276 on hv-cinder-85391 Sep 02 05:35:30.906622 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-7078f4d4-f26c-4edd-8a99-6011c884a7bf req-9627222e-9b23-4f8d-9654-e0bbf736c1a7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101669 Sep 02 05:35:30.908040 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 654/1305] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:35:31.423620 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-e5fb87e6-076a-4e97-be53-1874e68179c5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:35:31.424395 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-e5fb87e6-076a-4e97-be53-1874e68179c5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 47d13255-9c47-4bba-a83c-1bba0adb6276] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:35:31.433306 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e5fb87e6-076a-4e97-be53-1874e68179c5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:31.433838 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e5fb87e6-076a-4e97-be53-1874e68179c5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:31.434425 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e5fb87e6-076a-4e97-be53-1874e68179c5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:31.435233 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e5fb87e6-076a-4e97-be53-1874e68179c5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:31.435692 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e5fb87e6-076a-4e97-be53-1874e68179c5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:31.436142 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e5fb87e6-076a-4e97-be53-1874e68179c5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:31.469951 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e5fb87e6-076a-4e97-be53-1874e68179c5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:31.470418 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e5fb87e6-076a-4e97-be53-1874e68179c5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:31.470883 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e5fb87e6-076a-4e97-be53-1874e68179c5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:31.471304 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.objects.instance [None req-e5fb87e6-076a-4e97-be53-1874e68179c5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lazy-loading 'fault' on Instance uuid 47d13255-9c47-4bba-a83c-1bba0adb6276 {{(pid=120448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:35:31.521195 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-e5fb87e6-076a-4e97-be53-1874e68179c5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1a3027b52f4b46bc5cff18f9cd0b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0847ca942df54b659e8723463ab72c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:31.529594 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-e5fb87e6-076a-4e97-be53-1874e68179c5 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276" status: 200 len: 1331 microversion: 2.1 time: 0.110951 Sep 02 05:35:31.530169 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 652/1306] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:35:31 2022] GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276 => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:35:32.555966 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-b460e271-1855-42ed-b764-73c7058fd13f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:35:32.556643 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-b460e271-1855-42ed-b764-73c7058fd13f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 47d13255-9c47-4bba-a83c-1bba0adb6276] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:35:32.566639 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b460e271-1855-42ed-b764-73c7058fd13f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:32.567122 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b460e271-1855-42ed-b764-73c7058fd13f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:32.567552 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b460e271-1855-42ed-b764-73c7058fd13f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:32.568257 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b460e271-1855-42ed-b764-73c7058fd13f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:32.568703 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b460e271-1855-42ed-b764-73c7058fd13f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:32.569120 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b460e271-1855-42ed-b764-73c7058fd13f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:32.583178 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.wsgi [None req-b460e271-1855-42ed-b764-73c7058fd13f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] HTTP exception thrown: Instance 47d13255-9c47-4bba-a83c-1bba0adb6276 could not be found. Sep 02 05:35:32.584816 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-b460e271-1855-42ed-b764-73c7058fd13f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Request method failure captured: Sep 02 05:35:32.584816 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: request: GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276 HTTP/1.1 Sep 02 05:35:32.584816 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept: application/json Sep 02 05:35:32.584816 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept-Encoding: identity Sep 02 05:35:32.584816 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Connection: close Sep 02 05:35:32.584816 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Length: 0 Sep 02 05:35:32.584816 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Type: application/json Sep 02 05:35:32.584816 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Host: 10.222.0.30 Sep 02 05:35:32.584816 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Openstack-System-Scope: None Sep 02 05:35:32.584816 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: User-Agent: python-urllib3/1.26.12 Sep 02 05:35:32.584816 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Auth-Token: gAAAAABjEZM9sMpwUr9qoyGfMjDaBJ8P6YvBPQ-f9EMy1v-mwCEwm2r_bgyQO13MJw9PzuA9JX3XTWqubrdQgU1a6BCBynzOqQh_kSQW7GnBay9PYEuOinJQJVybarMVc5DymGEpqCE1wXufVXEiHhxifOsWWijBJ0RmMiTE9rG9XyLkwahJIcQ Sep 02 05:35:32.584816 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Id: None Sep 02 05:35:32.584816 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Name: None Sep 02 05:35:32.584816 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Identity-Status: Confirmed Sep 02 05:35:32.584816 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Is-Admin-Project: True Sep 02 05:35:32.584816 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Id: default Sep 02 05:35:32.584816 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Name: Default Sep 02 05:35:32.584816 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Id: 0847ca942df54b659e8723463ab72c65 Sep 02 05:35:32.584816 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Name: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:35:32.584816 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Role: member,reader Sep 02 05:35:32.584816 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Roles: member,reader Sep 02 05:35:32.586596 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0847ca942df54b659e8723463ab72c65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0847ca942df54b659e8723463ab72c65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0847ca942df54b659e8723463ab72c65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0847ca942df54b659e8723463ab72c65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:35:32.586596 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:35:32.586596 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Id: 0847ca942df54b659e8723463ab72c65 Sep 02 05:35:32.586596 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:35:32.586596 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User: tempest-AttachVolumeNegativeTest-1685577678-project Sep 02 05:35:32.586596 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Id: default Sep 02 05:35:32.586596 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Name: Default Sep 02 05:35:32.586596 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Id: ee1a3027b52f4b46bc5cff18f9cd0b02 Sep 02 05:35:32.586596 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Name: tempest-AttachVolumeNegativeTest-1685577678-project Sep 02 05:35:32.586596 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: method: > Sep 02 05:35:32.586596 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: exception: Instance 47d13255-9c47-4bba-a83c-1bba0adb6276 could not be found. Sep 02 05:35:32.586596 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: action_args: {'id': '47d13255-9c47-4bba-a83c-1bba0adb6276'} Sep 02 05:35:32.587589 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:35:32.587589 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:35:32.587589 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:35:32.587589 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:35:32.587589 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:35:32.587589 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:35:32.587589 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:35:32.587589 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:35:32.587589 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:35:32.587589 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:35:32.587589 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47d13255-9c47-4bba-a83c-1bba0adb6276 could not be found. Sep 02 05:35:32.587589 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:35:32.587589 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:35:32.587589 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:35:32.587589 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:35:32.587589 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:35:32.587589 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:35:32.587589 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:35:32.587589 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:35:32.587589 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:35:32.589310 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:35:32.589310 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:35:32.589310 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:35:32.589310 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:35:32.589310 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:35:32.589310 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:35:32.589310 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:35:32.589310 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47d13255-9c47-4bba-a83c-1bba0adb6276 could not be found. Sep 02 05:35:32.589310 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:35:32.589310 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:35:32.589310 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:35:32.589310 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:35:32.589310 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:35:32.589310 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:35:32.589310 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:35:32.589310 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:35:32.589310 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47d13255-9c47-4bba-a83c-1bba0adb6276 could not be found. Sep 02 05:35:32.589310 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:35:32.590696 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-b460e271-1855-42ed-b764-73c7058fd13f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Returning 404 to user: Instance 47d13255-9c47-4bba-a83c-1bba0adb6276 could not be found. {{(pid=120449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:35:32.590696 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-b460e271-1855-42ed-b764-73c7058fd13f tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276" status: 404 len: 111 microversion: 2.1 time: 0.037807 Sep 02 05:35:32.590696 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 655/1307] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:35:32 2022] GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:35:32.595302 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-3b96d7ef-878c-4a3d-8684-43e9fa17e203 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '.version_select at 0x7fc90b2c7160>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:35:32.620933 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-3b96d7ef-878c-4a3d-8684-43e9fa17e203 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1769682523" status: 202 len: 0 microversion: 2.1 time: 0.029410 Sep 02 05:35:32.621482 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 653/1308] 10.222.0.30 () {58 vars in 1221 bytes} [Fri Sep 2 05:35:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1769682523 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:35:34.405594 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-3a1d19dd-698c-4a9d-8f46-775aac11a57d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:35:34.406128 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-3a1d19dd-698c-4a9d-8f46-775aac11a57d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 47d13255-9c47-4bba-a83c-1bba0adb6276] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:35:34.412858 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3a1d19dd-698c-4a9d-8f46-775aac11a57d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:34.413337 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3a1d19dd-698c-4a9d-8f46-775aac11a57d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:34.413761 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3a1d19dd-698c-4a9d-8f46-775aac11a57d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:34.414812 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3a1d19dd-698c-4a9d-8f46-775aac11a57d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:34.415390 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3a1d19dd-698c-4a9d-8f46-775aac11a57d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:34.415810 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-3a1d19dd-698c-4a9d-8f46-775aac11a57d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:34.429068 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.wsgi [None req-3a1d19dd-698c-4a9d-8f46-775aac11a57d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] HTTP exception thrown: Instance 47d13255-9c47-4bba-a83c-1bba0adb6276 could not be found. Sep 02 05:35:34.430576 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-3a1d19dd-698c-4a9d-8f46-775aac11a57d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Request method failure captured: Sep 02 05:35:34.430576 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: request: DELETE /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276 HTTP/1.1 Sep 02 05:35:34.430576 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept: application/json Sep 02 05:35:34.430576 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept-Encoding: identity Sep 02 05:35:34.430576 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Connection: close Sep 02 05:35:34.430576 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Length: 0 Sep 02 05:35:34.430576 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Type: application/json Sep 02 05:35:34.430576 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Host: 10.222.0.30 Sep 02 05:35:34.430576 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Openstack-System-Scope: None Sep 02 05:35:34.430576 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: User-Agent: python-urllib3/1.26.12 Sep 02 05:35:34.430576 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Auth-Token: gAAAAABjEZM9sMpwUr9qoyGfMjDaBJ8P6YvBPQ-f9EMy1v-mwCEwm2r_bgyQO13MJw9PzuA9JX3XTWqubrdQgU1a6BCBynzOqQh_kSQW7GnBay9PYEuOinJQJVybarMVc5DymGEpqCE1wXufVXEiHhxifOsWWijBJ0RmMiTE9rG9XyLkwahJIcQ Sep 02 05:35:34.430576 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Id: None Sep 02 05:35:34.430576 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Name: None Sep 02 05:35:34.430576 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Identity-Status: Confirmed Sep 02 05:35:34.430576 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Is-Admin-Project: True Sep 02 05:35:34.430576 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Id: default Sep 02 05:35:34.430576 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Name: Default Sep 02 05:35:34.430576 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Id: 0847ca942df54b659e8723463ab72c65 Sep 02 05:35:34.430576 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Name: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:35:34.430576 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Role: member,reader Sep 02 05:35:34.430576 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Roles: member,reader Sep 02 05:35:34.432346 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0847ca942df54b659e8723463ab72c65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0847ca942df54b659e8723463ab72c65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0847ca942df54b659e8723463ab72c65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0847ca942df54b659e8723463ab72c65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:35:34.432346 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:35:34.432346 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Id: 0847ca942df54b659e8723463ab72c65 Sep 02 05:35:34.432346 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:35:34.432346 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User: tempest-AttachVolumeNegativeTest-1685577678-project Sep 02 05:35:34.432346 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Id: default Sep 02 05:35:34.432346 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Name: Default Sep 02 05:35:34.432346 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Id: ee1a3027b52f4b46bc5cff18f9cd0b02 Sep 02 05:35:34.432346 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Name: tempest-AttachVolumeNegativeTest-1685577678-project Sep 02 05:35:34.432346 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: method: > Sep 02 05:35:34.432346 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: exception: Instance 47d13255-9c47-4bba-a83c-1bba0adb6276 could not be found. Sep 02 05:35:34.432346 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: action_args: {'id': '47d13255-9c47-4bba-a83c-1bba0adb6276'} Sep 02 05:35:34.433280 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:35:34.433280 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:35:34.433280 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:35:34.433280 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:35:34.433280 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:35:34.433280 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:35:34.433280 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:35:34.433280 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:35:34.433280 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:35:34.433280 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:35:34.433280 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47d13255-9c47-4bba-a83c-1bba0adb6276 could not be found. Sep 02 05:35:34.433280 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:35:34.433280 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:35:34.433280 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:35:34.433280 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:35:34.433280 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:35:34.433280 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:35:34.433280 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:35:34.433280 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:35:34.433280 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:35:34.434774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:35:34.434774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 05:35:34.434774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 05:35:34.434774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 05:35:34.434774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 05:35:34.434774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:35:34.434774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:35:34.434774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:35:34.434774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:35:34.434774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47d13255-9c47-4bba-a83c-1bba0adb6276 could not be found. Sep 02 05:35:34.434774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:35:34.434774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:35:34.434774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:35:34.434774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:35:34.434774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:35:34.434774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:35:34.434774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:35:34.434774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:35:34.434774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47d13255-9c47-4bba-a83c-1bba0adb6276 could not be found. Sep 02 05:35:34.434774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:35:34.436336 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-3a1d19dd-698c-4a9d-8f46-775aac11a57d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Returning 404 to user: Instance 47d13255-9c47-4bba-a83c-1bba0adb6276 could not be found. {{(pid=120449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:35:34.436336 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-3a1d19dd-698c-4a9d-8f46-775aac11a57d tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "DELETE /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276" status: 404 len: 111 microversion: 2.1 time: 0.030766 Sep 02 05:35:34.436336 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 656/1309] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Sep 2 05:35:34 2022] DELETE /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:35:34.441985 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-ddb5a61b-7d26-4141-acca-2e78971a7328 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:35:34.442583 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-ddb5a61b-7d26-4141-acca-2e78971a7328 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 47d13255-9c47-4bba-a83c-1bba0adb6276] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:35:34.450937 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ddb5a61b-7d26-4141-acca-2e78971a7328 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:34.451420 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ddb5a61b-7d26-4141-acca-2e78971a7328 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:34.451856 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ddb5a61b-7d26-4141-acca-2e78971a7328 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:34.452579 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ddb5a61b-7d26-4141-acca-2e78971a7328 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:34.453031 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ddb5a61b-7d26-4141-acca-2e78971a7328 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:34.453456 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ddb5a61b-7d26-4141-acca-2e78971a7328 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:34.466516 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.wsgi [None req-ddb5a61b-7d26-4141-acca-2e78971a7328 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] HTTP exception thrown: Instance 47d13255-9c47-4bba-a83c-1bba0adb6276 could not be found. Sep 02 05:35:34.468228 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-ddb5a61b-7d26-4141-acca-2e78971a7328 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Request method failure captured: Sep 02 05:35:34.468228 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: request: GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276 HTTP/1.1 Sep 02 05:35:34.468228 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept: application/json Sep 02 05:35:34.468228 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept-Encoding: identity Sep 02 05:35:34.468228 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Connection: close Sep 02 05:35:34.468228 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Length: 0 Sep 02 05:35:34.468228 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Type: application/json Sep 02 05:35:34.468228 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Host: 10.222.0.30 Sep 02 05:35:34.468228 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Openstack-System-Scope: None Sep 02 05:35:34.468228 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: User-Agent: python-urllib3/1.26.12 Sep 02 05:35:34.468228 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Auth-Token: gAAAAABjEZM9sMpwUr9qoyGfMjDaBJ8P6YvBPQ-f9EMy1v-mwCEwm2r_bgyQO13MJw9PzuA9JX3XTWqubrdQgU1a6BCBynzOqQh_kSQW7GnBay9PYEuOinJQJVybarMVc5DymGEpqCE1wXufVXEiHhxifOsWWijBJ0RmMiTE9rG9XyLkwahJIcQ Sep 02 05:35:34.468228 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Id: None Sep 02 05:35:34.468228 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Name: None Sep 02 05:35:34.468228 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Identity-Status: Confirmed Sep 02 05:35:34.468228 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Is-Admin-Project: True Sep 02 05:35:34.468228 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Id: default Sep 02 05:35:34.468228 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Name: Default Sep 02 05:35:34.468228 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Id: 0847ca942df54b659e8723463ab72c65 Sep 02 05:35:34.468228 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Name: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:35:34.468228 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Role: member,reader Sep 02 05:35:34.468228 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Roles: member,reader Sep 02 05:35:34.470787 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0847ca942df54b659e8723463ab72c65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0847ca942df54b659e8723463ab72c65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0847ca942df54b659e8723463ab72c65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0847ca942df54b659e8723463ab72c65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:35:34.470787 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:35:34.470787 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Id: 0847ca942df54b659e8723463ab72c65 Sep 02 05:35:34.470787 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:35:34.470787 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User: tempest-AttachVolumeNegativeTest-1685577678-project Sep 02 05:35:34.470787 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Id: default Sep 02 05:35:34.470787 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Name: Default Sep 02 05:35:34.470787 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Id: ee1a3027b52f4b46bc5cff18f9cd0b02 Sep 02 05:35:34.470787 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Name: tempest-AttachVolumeNegativeTest-1685577678-project Sep 02 05:35:34.470787 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: method: > Sep 02 05:35:34.470787 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: exception: Instance 47d13255-9c47-4bba-a83c-1bba0adb6276 could not be found. Sep 02 05:35:34.470787 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: action_args: {'id': '47d13255-9c47-4bba-a83c-1bba0adb6276'} Sep 02 05:35:34.472356 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:35:34.472356 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:35:34.472356 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:35:34.472356 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:35:34.472356 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:35:34.472356 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:35:34.472356 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:35:34.472356 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:35:34.472356 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:35:34.472356 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:35:34.472356 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47d13255-9c47-4bba-a83c-1bba0adb6276 could not be found. Sep 02 05:35:34.472356 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:35:34.472356 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:35:34.472356 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:35:34.472356 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:35:34.472356 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:35:34.472356 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:35:34.472356 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:35:34.472356 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:35:34.472356 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:35:34.475878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:35:34.475878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:35:34.475878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:35:34.475878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:35:34.475878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:35:34.475878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:35:34.475878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:35:34.475878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47d13255-9c47-4bba-a83c-1bba0adb6276 could not be found. Sep 02 05:35:34.475878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:35:34.475878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:35:34.475878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:35:34.475878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:35:34.475878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:35:34.475878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:35:34.475878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:35:34.475878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:35:34.475878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47d13255-9c47-4bba-a83c-1bba0adb6276 could not be found. Sep 02 05:35:34.475878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:35:34.479361 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-ddb5a61b-7d26-4141-acca-2e78971a7328 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Returning 404 to user: Instance 47d13255-9c47-4bba-a83c-1bba0adb6276 could not be found. {{(pid=120448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:35:34.479361 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-ddb5a61b-7d26-4141-acca-2e78971a7328 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276" status: 404 len: 111 microversion: 2.1 time: 0.032102 Sep 02 05:35:34.479361 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 654/1310] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:35:34 2022] GET /compute/v2.1/servers/47d13255-9c47-4bba-a83c-1bba0adb6276 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:35:35.628057 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-89e211bb-c434-476f-837d-ef24228b4297 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:35:35.628666 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-89e211bb-c434-476f-837d-ef24228b4297 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:35:35.635744 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-89e211bb-c434-476f-837d-ef24228b4297 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:35.636247 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-89e211bb-c434-476f-837d-ef24228b4297 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:35.636685 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-89e211bb-c434-476f-837d-ef24228b4297 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:35.637373 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-89e211bb-c434-476f-837d-ef24228b4297 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:35.637819 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-89e211bb-c434-476f-837d-ef24228b4297 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:35.638240 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-89e211bb-c434-476f-837d-ef24228b4297 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:35.651773 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.wsgi [None req-89e211bb-c434-476f-837d-ef24228b4297 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] HTTP exception thrown: Instance 1d783711-2893-40ce-8b8b-800090dd1ef0 could not be found. Sep 02 05:35:35.653326 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-89e211bb-c434-476f-837d-ef24228b4297 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Request method failure captured: Sep 02 05:35:35.653326 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: request: DELETE /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0 HTTP/1.1 Sep 02 05:35:35.653326 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept: application/json Sep 02 05:35:35.653326 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept-Encoding: identity Sep 02 05:35:35.653326 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Connection: close Sep 02 05:35:35.653326 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Length: 0 Sep 02 05:35:35.653326 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Type: application/json Sep 02 05:35:35.653326 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Host: 10.222.0.30 Sep 02 05:35:35.653326 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Openstack-System-Scope: None Sep 02 05:35:35.653326 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: User-Agent: python-urllib3/1.26.12 Sep 02 05:35:35.653326 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Auth-Token: gAAAAABjEZM9sMpwUr9qoyGfMjDaBJ8P6YvBPQ-f9EMy1v-mwCEwm2r_bgyQO13MJw9PzuA9JX3XTWqubrdQgU1a6BCBynzOqQh_kSQW7GnBay9PYEuOinJQJVybarMVc5DymGEpqCE1wXufVXEiHhxifOsWWijBJ0RmMiTE9rG9XyLkwahJIcQ Sep 02 05:35:35.653326 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Id: None Sep 02 05:35:35.653326 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Name: None Sep 02 05:35:35.653326 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Identity-Status: Confirmed Sep 02 05:35:35.653326 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Is-Admin-Project: True Sep 02 05:35:35.653326 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Id: default Sep 02 05:35:35.653326 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Name: Default Sep 02 05:35:35.653326 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Id: 0847ca942df54b659e8723463ab72c65 Sep 02 05:35:35.653326 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Name: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:35:35.653326 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Role: member,reader Sep 02 05:35:35.653326 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Roles: member,reader Sep 02 05:35:35.655121 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0847ca942df54b659e8723463ab72c65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0847ca942df54b659e8723463ab72c65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0847ca942df54b659e8723463ab72c65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0847ca942df54b659e8723463ab72c65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:35:35.655121 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:35:35.655121 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Id: 0847ca942df54b659e8723463ab72c65 Sep 02 05:35:35.655121 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:35:35.655121 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User: tempest-AttachVolumeNegativeTest-1685577678-project Sep 02 05:35:35.655121 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Id: default Sep 02 05:35:35.655121 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Name: Default Sep 02 05:35:35.655121 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Id: ee1a3027b52f4b46bc5cff18f9cd0b02 Sep 02 05:35:35.655121 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Name: tempest-AttachVolumeNegativeTest-1685577678-project Sep 02 05:35:35.655121 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: method: > Sep 02 05:35:35.655121 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: exception: Instance 1d783711-2893-40ce-8b8b-800090dd1ef0 could not be found. Sep 02 05:35:35.655121 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: action_args: {'id': '1d783711-2893-40ce-8b8b-800090dd1ef0'} Sep 02 05:35:35.655929 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:35:35.655929 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:35:35.655929 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:35:35.655929 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:35:35.655929 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:35:35.655929 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:35:35.655929 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:35:35.655929 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:35:35.655929 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:35:35.655929 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:35:35.655929 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d783711-2893-40ce-8b8b-800090dd1ef0 could not be found. Sep 02 05:35:35.655929 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:35:35.655929 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:35:35.655929 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:35:35.655929 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:35:35.655929 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:35:35.655929 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:35:35.655929 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:35:35.655929 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:35:35.655929 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:35:35.657262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:35:35.657262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 05:35:35.657262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 05:35:35.657262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 05:35:35.657262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 05:35:35.657262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:35:35.657262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:35:35.657262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:35:35.657262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:35:35.657262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d783711-2893-40ce-8b8b-800090dd1ef0 could not be found. Sep 02 05:35:35.657262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:35:35.657262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:35:35.657262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:35:35.657262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:35:35.657262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:35:35.657262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:35:35.657262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:35:35.657262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:35:35.657262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d783711-2893-40ce-8b8b-800090dd1ef0 could not be found. Sep 02 05:35:35.657262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:35:35.658524 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-89e211bb-c434-476f-837d-ef24228b4297 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Returning 404 to user: Instance 1d783711-2893-40ce-8b8b-800090dd1ef0 could not be found. {{(pid=120449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:35:35.658524 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-89e211bb-c434-476f-837d-ef24228b4297 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0" status: 404 len: 111 microversion: 2.1 time: 0.030628 Sep 02 05:35:35.658524 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 657/1311] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Sep 2 05:35:35 2022] DELETE /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:35:35.663766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-3f0cdf7d-ce71-4a8a-b945-7d93dcd40a28 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:35:35.664404 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-3f0cdf7d-ce71-4a8a-b945-7d93dcd40a28 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 1d783711-2893-40ce-8b8b-800090dd1ef0] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:35:35.671287 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3f0cdf7d-ce71-4a8a-b945-7d93dcd40a28 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:35.671758 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3f0cdf7d-ce71-4a8a-b945-7d93dcd40a28 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:35.672234 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3f0cdf7d-ce71-4a8a-b945-7d93dcd40a28 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:35.672904 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3f0cdf7d-ce71-4a8a-b945-7d93dcd40a28 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:35.673342 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3f0cdf7d-ce71-4a8a-b945-7d93dcd40a28 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:35.673759 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3f0cdf7d-ce71-4a8a-b945-7d93dcd40a28 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:35.687180 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.wsgi [None req-3f0cdf7d-ce71-4a8a-b945-7d93dcd40a28 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] HTTP exception thrown: Instance 1d783711-2893-40ce-8b8b-800090dd1ef0 could not be found. Sep 02 05:35:35.688741 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-3f0cdf7d-ce71-4a8a-b945-7d93dcd40a28 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Request method failure captured: Sep 02 05:35:35.688741 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: request: GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0 HTTP/1.1 Sep 02 05:35:35.688741 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept: application/json Sep 02 05:35:35.688741 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept-Encoding: identity Sep 02 05:35:35.688741 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Connection: close Sep 02 05:35:35.688741 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Length: 0 Sep 02 05:35:35.688741 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Type: application/json Sep 02 05:35:35.688741 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Host: 10.222.0.30 Sep 02 05:35:35.688741 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Openstack-System-Scope: None Sep 02 05:35:35.688741 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: User-Agent: python-urllib3/1.26.12 Sep 02 05:35:35.688741 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Auth-Token: gAAAAABjEZM9sMpwUr9qoyGfMjDaBJ8P6YvBPQ-f9EMy1v-mwCEwm2r_bgyQO13MJw9PzuA9JX3XTWqubrdQgU1a6BCBynzOqQh_kSQW7GnBay9PYEuOinJQJVybarMVc5DymGEpqCE1wXufVXEiHhxifOsWWijBJ0RmMiTE9rG9XyLkwahJIcQ Sep 02 05:35:35.688741 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Id: None Sep 02 05:35:35.688741 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Name: None Sep 02 05:35:35.688741 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Identity-Status: Confirmed Sep 02 05:35:35.688741 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Is-Admin-Project: True Sep 02 05:35:35.688741 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Id: default Sep 02 05:35:35.688741 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Name: Default Sep 02 05:35:35.688741 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Id: 0847ca942df54b659e8723463ab72c65 Sep 02 05:35:35.688741 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Name: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:35:35.688741 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Role: member,reader Sep 02 05:35:35.688741 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Roles: member,reader Sep 02 05:35:35.690307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0847ca942df54b659e8723463ab72c65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0847ca942df54b659e8723463ab72c65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0847ca942df54b659e8723463ab72c65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0847ca942df54b659e8723463ab72c65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:35:35.690307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:35:35.690307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Id: 0847ca942df54b659e8723463ab72c65 Sep 02 05:35:35.690307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:35:35.690307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User: tempest-AttachVolumeNegativeTest-1685577678-project Sep 02 05:35:35.690307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Id: default Sep 02 05:35:35.690307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Name: Default Sep 02 05:35:35.690307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Id: ee1a3027b52f4b46bc5cff18f9cd0b02 Sep 02 05:35:35.690307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Name: tempest-AttachVolumeNegativeTest-1685577678-project Sep 02 05:35:35.690307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: method: > Sep 02 05:35:35.690307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: exception: Instance 1d783711-2893-40ce-8b8b-800090dd1ef0 could not be found. Sep 02 05:35:35.690307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: action_args: {'id': '1d783711-2893-40ce-8b8b-800090dd1ef0'} Sep 02 05:35:35.691193 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:35:35.691193 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:35:35.691193 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:35:35.691193 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:35:35.691193 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:35:35.691193 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:35:35.691193 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:35:35.691193 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:35:35.691193 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:35:35.691193 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:35:35.691193 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d783711-2893-40ce-8b8b-800090dd1ef0 could not be found. Sep 02 05:35:35.691193 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:35:35.691193 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:35:35.691193 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:35:35.691193 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:35:35.691193 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:35:35.691193 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:35:35.691193 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:35:35.691193 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:35:35.691193 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:35:35.692668 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:35:35.692668 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:35:35.692668 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:35:35.692668 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:35:35.692668 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:35:35.692668 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:35:35.692668 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:35:35.692668 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d783711-2893-40ce-8b8b-800090dd1ef0 could not be found. Sep 02 05:35:35.692668 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:35:35.692668 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:35:35.692668 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:35:35.692668 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:35:35.692668 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:35:35.692668 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:35:35.692668 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:35:35.692668 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:35:35.692668 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d783711-2893-40ce-8b8b-800090dd1ef0 could not be found. Sep 02 05:35:35.692668 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:35:35.693983 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-3f0cdf7d-ce71-4a8a-b945-7d93dcd40a28 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Returning 404 to user: Instance 1d783711-2893-40ce-8b8b-800090dd1ef0 could not be found. {{(pid=120448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:35:35.693983 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-3f0cdf7d-ce71-4a8a-b945-7d93dcd40a28 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0" status: 404 len: 111 microversion: 2.1 time: 0.030217 Sep 02 05:35:35.693983 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 655/1312] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:35:35 2022] GET /compute/v2.1/servers/1d783711-2893-40ce-8b8b-800090dd1ef0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:35:35.698640 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-67ecbaad-e034-42ad-9e61-192c29b134fb tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:35:35.699113 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-67ecbaad-e034-42ad-9e61-192c29b134fb tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:35:35.705445 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-67ecbaad-e034-42ad-9e61-192c29b134fb tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:35.705936 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-67ecbaad-e034-42ad-9e61-192c29b134fb tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:35.706369 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-67ecbaad-e034-42ad-9e61-192c29b134fb tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:35.707054 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-67ecbaad-e034-42ad-9e61-192c29b134fb tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:35.707502 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-67ecbaad-e034-42ad-9e61-192c29b134fb tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:35.707920 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-67ecbaad-e034-42ad-9e61-192c29b134fb tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:35.721572 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.wsgi [None req-67ecbaad-e034-42ad-9e61-192c29b134fb tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] HTTP exception thrown: Instance e74e8e64-b53c-431b-bb9c-34e58ee81d9a could not be found. Sep 02 05:35:35.723100 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-67ecbaad-e034-42ad-9e61-192c29b134fb tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Request method failure captured: Sep 02 05:35:35.723100 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: request: DELETE /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a HTTP/1.1 Sep 02 05:35:35.723100 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept: application/json Sep 02 05:35:35.723100 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept-Encoding: identity Sep 02 05:35:35.723100 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Connection: close Sep 02 05:35:35.723100 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Length: 0 Sep 02 05:35:35.723100 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Type: application/json Sep 02 05:35:35.723100 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Host: 10.222.0.30 Sep 02 05:35:35.723100 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Openstack-System-Scope: None Sep 02 05:35:35.723100 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: User-Agent: python-urllib3/1.26.12 Sep 02 05:35:35.723100 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Auth-Token: gAAAAABjEZM9sMpwUr9qoyGfMjDaBJ8P6YvBPQ-f9EMy1v-mwCEwm2r_bgyQO13MJw9PzuA9JX3XTWqubrdQgU1a6BCBynzOqQh_kSQW7GnBay9PYEuOinJQJVybarMVc5DymGEpqCE1wXufVXEiHhxifOsWWijBJ0RmMiTE9rG9XyLkwahJIcQ Sep 02 05:35:35.723100 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Id: None Sep 02 05:35:35.723100 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Name: None Sep 02 05:35:35.723100 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Identity-Status: Confirmed Sep 02 05:35:35.723100 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Is-Admin-Project: True Sep 02 05:35:35.723100 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Id: default Sep 02 05:35:35.723100 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Name: Default Sep 02 05:35:35.723100 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Id: 0847ca942df54b659e8723463ab72c65 Sep 02 05:35:35.723100 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Name: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:35:35.723100 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Role: member,reader Sep 02 05:35:35.723100 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Roles: member,reader Sep 02 05:35:35.724791 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0847ca942df54b659e8723463ab72c65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0847ca942df54b659e8723463ab72c65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0847ca942df54b659e8723463ab72c65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0847ca942df54b659e8723463ab72c65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:35:35.724791 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:35:35.724791 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Id: 0847ca942df54b659e8723463ab72c65 Sep 02 05:35:35.724791 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:35:35.724791 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User: tempest-AttachVolumeNegativeTest-1685577678-project Sep 02 05:35:35.724791 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Id: default Sep 02 05:35:35.724791 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Name: Default Sep 02 05:35:35.724791 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Id: ee1a3027b52f4b46bc5cff18f9cd0b02 Sep 02 05:35:35.724791 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Name: tempest-AttachVolumeNegativeTest-1685577678-project Sep 02 05:35:35.724791 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: method: > Sep 02 05:35:35.724791 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: exception: Instance e74e8e64-b53c-431b-bb9c-34e58ee81d9a could not be found. Sep 02 05:35:35.724791 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: action_args: {'id': 'e74e8e64-b53c-431b-bb9c-34e58ee81d9a'} Sep 02 05:35:35.725597 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:35:35.725597 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:35:35.725597 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:35:35.725597 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:35:35.725597 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:35:35.725597 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:35:35.725597 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:35:35.725597 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:35:35.725597 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:35:35.725597 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:35:35.725597 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e74e8e64-b53c-431b-bb9c-34e58ee81d9a could not be found. Sep 02 05:35:35.725597 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:35:35.725597 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:35:35.725597 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:35:35.725597 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:35:35.725597 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:35:35.725597 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:35:35.725597 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:35:35.725597 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:35:35.725597 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:35:35.726838 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:35:35.726838 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 05:35:35.726838 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 05:35:35.726838 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 05:35:35.726838 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 05:35:35.726838 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:35:35.726838 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:35:35.726838 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:35:35.726838 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:35:35.726838 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e74e8e64-b53c-431b-bb9c-34e58ee81d9a could not be found. Sep 02 05:35:35.726838 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:35:35.726838 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:35:35.726838 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:35:35.726838 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:35:35.726838 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:35:35.726838 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:35:35.726838 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:35:35.726838 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:35:35.726838 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e74e8e64-b53c-431b-bb9c-34e58ee81d9a could not be found. Sep 02 05:35:35.726838 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:35:35.728085 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-67ecbaad-e034-42ad-9e61-192c29b134fb tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Returning 404 to user: Instance e74e8e64-b53c-431b-bb9c-34e58ee81d9a could not be found. {{(pid=120449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:35:35.728085 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-67ecbaad-e034-42ad-9e61-192c29b134fb tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a" status: 404 len: 111 microversion: 2.1 time: 0.029804 Sep 02 05:35:35.728085 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 658/1313] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Sep 2 05:35:35 2022] DELETE /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:35:35.733272 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-c0309046-d1f4-4a3b-98b4-77342ac50c12 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:35:35.733876 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-c0309046-d1f4-4a3b-98b4-77342ac50c12 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: e74e8e64-b53c-431b-bb9c-34e58ee81d9a] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:35:35.740390 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c0309046-d1f4-4a3b-98b4-77342ac50c12 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:35.740862 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c0309046-d1f4-4a3b-98b4-77342ac50c12 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:35.741283 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c0309046-d1f4-4a3b-98b4-77342ac50c12 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:35.741955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c0309046-d1f4-4a3b-98b4-77342ac50c12 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:35.742492 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c0309046-d1f4-4a3b-98b4-77342ac50c12 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:35.742800 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c0309046-d1f4-4a3b-98b4-77342ac50c12 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:35.756076 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.wsgi [None req-c0309046-d1f4-4a3b-98b4-77342ac50c12 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] HTTP exception thrown: Instance e74e8e64-b53c-431b-bb9c-34e58ee81d9a could not be found. Sep 02 05:35:35.757590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-c0309046-d1f4-4a3b-98b4-77342ac50c12 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Request method failure captured: Sep 02 05:35:35.757590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: request: GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a HTTP/1.1 Sep 02 05:35:35.757590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept: application/json Sep 02 05:35:35.757590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept-Encoding: identity Sep 02 05:35:35.757590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Connection: close Sep 02 05:35:35.757590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Length: 0 Sep 02 05:35:35.757590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Type: application/json Sep 02 05:35:35.757590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Host: 10.222.0.30 Sep 02 05:35:35.757590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Openstack-System-Scope: None Sep 02 05:35:35.757590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: User-Agent: python-urllib3/1.26.12 Sep 02 05:35:35.757590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Auth-Token: gAAAAABjEZM9sMpwUr9qoyGfMjDaBJ8P6YvBPQ-f9EMy1v-mwCEwm2r_bgyQO13MJw9PzuA9JX3XTWqubrdQgU1a6BCBynzOqQh_kSQW7GnBay9PYEuOinJQJVybarMVc5DymGEpqCE1wXufVXEiHhxifOsWWijBJ0RmMiTE9rG9XyLkwahJIcQ Sep 02 05:35:35.757590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Id: None Sep 02 05:35:35.757590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Name: None Sep 02 05:35:35.757590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Identity-Status: Confirmed Sep 02 05:35:35.757590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Is-Admin-Project: True Sep 02 05:35:35.757590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Id: default Sep 02 05:35:35.757590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Name: Default Sep 02 05:35:35.757590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Id: 0847ca942df54b659e8723463ab72c65 Sep 02 05:35:35.757590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Name: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:35:35.757590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Role: member,reader Sep 02 05:35:35.757590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Roles: member,reader Sep 02 05:35:35.759237 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0847ca942df54b659e8723463ab72c65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0847ca942df54b659e8723463ab72c65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0847ca942df54b659e8723463ab72c65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0847ca942df54b659e8723463ab72c65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:35:35.759237 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:35:35.759237 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Id: 0847ca942df54b659e8723463ab72c65 Sep 02 05:35:35.759237 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:35:35.759237 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User: tempest-AttachVolumeNegativeTest-1685577678-project Sep 02 05:35:35.759237 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Id: default Sep 02 05:35:35.759237 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Name: Default Sep 02 05:35:35.759237 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Id: ee1a3027b52f4b46bc5cff18f9cd0b02 Sep 02 05:35:35.759237 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Name: tempest-AttachVolumeNegativeTest-1685577678-project Sep 02 05:35:35.759237 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: method: > Sep 02 05:35:35.759237 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: exception: Instance e74e8e64-b53c-431b-bb9c-34e58ee81d9a could not be found. Sep 02 05:35:35.759237 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: action_args: {'id': 'e74e8e64-b53c-431b-bb9c-34e58ee81d9a'} Sep 02 05:35:35.760239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:35:35.760239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:35:35.760239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:35:35.760239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:35:35.760239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:35:35.760239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:35:35.760239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:35:35.760239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:35:35.760239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:35:35.760239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:35:35.760239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e74e8e64-b53c-431b-bb9c-34e58ee81d9a could not be found. Sep 02 05:35:35.760239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:35:35.760239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:35:35.760239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:35:35.760239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:35:35.760239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:35:35.760239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:35:35.760239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:35:35.760239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:35:35.760239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:35:35.761751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:35:35.761751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:35:35.761751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:35:35.761751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:35:35.761751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:35:35.761751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:35:35.761751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:35:35.761751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e74e8e64-b53c-431b-bb9c-34e58ee81d9a could not be found. Sep 02 05:35:35.761751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:35:35.761751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:35:35.761751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:35:35.761751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:35:35.761751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:35:35.761751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:35:35.761751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:35:35.761751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:35:35.761751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e74e8e64-b53c-431b-bb9c-34e58ee81d9a could not be found. Sep 02 05:35:35.761751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:35:35.763035 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-c0309046-d1f4-4a3b-98b4-77342ac50c12 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Returning 404 to user: Instance e74e8e64-b53c-431b-bb9c-34e58ee81d9a could not be found. {{(pid=120448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:35:35.763035 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-c0309046-d1f4-4a3b-98b4-77342ac50c12 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a" status: 404 len: 111 microversion: 2.1 time: 0.029570 Sep 02 05:35:35.763035 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 656/1314] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:35:35 2022] GET /compute/v2.1/servers/e74e8e64-b53c-431b-bb9c-34e58ee81d9a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:35:36.921070 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-8a0cc323-8cb9-4ad8-9c42-271b7ec57a15 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:35:36.921571 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-8a0cc323-8cb9-4ad8-9c42-271b7ec57a15 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:35:36.928207 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8a0cc323-8cb9-4ad8-9c42-271b7ec57a15 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:36.928694 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8a0cc323-8cb9-4ad8-9c42-271b7ec57a15 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:36.929121 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8a0cc323-8cb9-4ad8-9c42-271b7ec57a15 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:36.929793 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8a0cc323-8cb9-4ad8-9c42-271b7ec57a15 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:36.930243 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8a0cc323-8cb9-4ad8-9c42-271b7ec57a15 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:36.930653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8a0cc323-8cb9-4ad8-9c42-271b7ec57a15 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:36.944594 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.wsgi [None req-8a0cc323-8cb9-4ad8-9c42-271b7ec57a15 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] HTTP exception thrown: Instance 6ecefc31-2d93-4601-91e7-0d18da502d8b could not be found. Sep 02 05:35:36.946115 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-8a0cc323-8cb9-4ad8-9c42-271b7ec57a15 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Request method failure captured: Sep 02 05:35:36.946115 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: request: DELETE /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b HTTP/1.1 Sep 02 05:35:36.946115 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept: application/json Sep 02 05:35:36.946115 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept-Encoding: identity Sep 02 05:35:36.946115 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Connection: close Sep 02 05:35:36.946115 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Length: 0 Sep 02 05:35:36.946115 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Type: application/json Sep 02 05:35:36.946115 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Host: 10.222.0.30 Sep 02 05:35:36.946115 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Openstack-System-Scope: None Sep 02 05:35:36.946115 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: User-Agent: python-urllib3/1.26.12 Sep 02 05:35:36.946115 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Auth-Token: gAAAAABjEZM9sMpwUr9qoyGfMjDaBJ8P6YvBPQ-f9EMy1v-mwCEwm2r_bgyQO13MJw9PzuA9JX3XTWqubrdQgU1a6BCBynzOqQh_kSQW7GnBay9PYEuOinJQJVybarMVc5DymGEpqCE1wXufVXEiHhxifOsWWijBJ0RmMiTE9rG9XyLkwahJIcQ Sep 02 05:35:36.946115 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Id: None Sep 02 05:35:36.946115 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Name: None Sep 02 05:35:36.946115 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Identity-Status: Confirmed Sep 02 05:35:36.946115 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Is-Admin-Project: True Sep 02 05:35:36.946115 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Id: default Sep 02 05:35:36.946115 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Name: Default Sep 02 05:35:36.946115 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Id: 0847ca942df54b659e8723463ab72c65 Sep 02 05:35:36.946115 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Name: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:35:36.946115 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Role: member,reader Sep 02 05:35:36.946115 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Roles: member,reader Sep 02 05:35:36.947800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0847ca942df54b659e8723463ab72c65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0847ca942df54b659e8723463ab72c65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0847ca942df54b659e8723463ab72c65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0847ca942df54b659e8723463ab72c65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:35:36.947800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:35:36.947800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Id: 0847ca942df54b659e8723463ab72c65 Sep 02 05:35:36.947800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:35:36.947800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User: tempest-AttachVolumeNegativeTest-1685577678-project Sep 02 05:35:36.947800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Id: default Sep 02 05:35:36.947800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Name: Default Sep 02 05:35:36.947800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Id: ee1a3027b52f4b46bc5cff18f9cd0b02 Sep 02 05:35:36.947800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Name: tempest-AttachVolumeNegativeTest-1685577678-project Sep 02 05:35:36.947800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: method: > Sep 02 05:35:36.947800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: exception: Instance 6ecefc31-2d93-4601-91e7-0d18da502d8b could not be found. Sep 02 05:35:36.947800 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: action_args: {'id': '6ecefc31-2d93-4601-91e7-0d18da502d8b'} Sep 02 05:35:36.948792 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:35:36.948792 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:35:36.948792 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:35:36.948792 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:35:36.948792 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:35:36.948792 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:35:36.948792 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:35:36.948792 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:35:36.948792 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:35:36.948792 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:35:36.948792 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ecefc31-2d93-4601-91e7-0d18da502d8b could not be found. Sep 02 05:35:36.948792 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:35:36.948792 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:35:36.948792 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:35:36.948792 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:35:36.948792 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:35:36.948792 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:35:36.948792 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:35:36.948792 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:35:36.948792 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:35:36.950270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:35:36.950270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 05:35:36.950270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 05:35:36.950270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 05:35:36.950270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 05:35:36.950270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:35:36.950270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:35:36.950270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:35:36.950270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:35:36.950270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ecefc31-2d93-4601-91e7-0d18da502d8b could not be found. Sep 02 05:35:36.950270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:35:36.950270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:35:36.950270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:35:36.950270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:35:36.950270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:35:36.950270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:35:36.950270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:35:36.950270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:35:36.950270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ecefc31-2d93-4601-91e7-0d18da502d8b could not be found. Sep 02 05:35:36.950270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:35:36.952100 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-8a0cc323-8cb9-4ad8-9c42-271b7ec57a15 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Returning 404 to user: Instance 6ecefc31-2d93-4601-91e7-0d18da502d8b could not be found. {{(pid=120449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:35:36.952100 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-8a0cc323-8cb9-4ad8-9c42-271b7ec57a15 tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 404 len: 111 microversion: 2.1 time: 0.030489 Sep 02 05:35:36.952100 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 659/1315] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Sep 2 05:35:36 2022] DELETE /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:35:36.957713 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-6842ee0c-e44b-412b-ab5e-f0a626cdceae tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:35:36.958468 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-6842ee0c-e44b-412b-ab5e-f0a626cdceae tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] [instance: 6ecefc31-2d93-4601-91e7-0d18da502d8b] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:35:36.966898 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6842ee0c-e44b-412b-ab5e-f0a626cdceae tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:36.967402 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6842ee0c-e44b-412b-ab5e-f0a626cdceae tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:36.967833 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6842ee0c-e44b-412b-ab5e-f0a626cdceae tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:36.968560 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6842ee0c-e44b-412b-ab5e-f0a626cdceae tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:36.969008 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6842ee0c-e44b-412b-ab5e-f0a626cdceae tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:36.969429 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6842ee0c-e44b-412b-ab5e-f0a626cdceae tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:36.983336 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.wsgi [None req-6842ee0c-e44b-412b-ab5e-f0a626cdceae tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] HTTP exception thrown: Instance 6ecefc31-2d93-4601-91e7-0d18da502d8b could not be found. Sep 02 05:35:36.984884 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-6842ee0c-e44b-412b-ab5e-f0a626cdceae tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Request method failure captured: Sep 02 05:35:36.984884 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: request: GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b HTTP/1.1 Sep 02 05:35:36.984884 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept: application/json Sep 02 05:35:36.984884 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept-Encoding: identity Sep 02 05:35:36.984884 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Connection: close Sep 02 05:35:36.984884 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Length: 0 Sep 02 05:35:36.984884 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Type: application/json Sep 02 05:35:36.984884 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Host: 10.222.0.30 Sep 02 05:35:36.984884 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Openstack-System-Scope: None Sep 02 05:35:36.984884 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: User-Agent: python-urllib3/1.26.12 Sep 02 05:35:36.984884 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Auth-Token: gAAAAABjEZM9sMpwUr9qoyGfMjDaBJ8P6YvBPQ-f9EMy1v-mwCEwm2r_bgyQO13MJw9PzuA9JX3XTWqubrdQgU1a6BCBynzOqQh_kSQW7GnBay9PYEuOinJQJVybarMVc5DymGEpqCE1wXufVXEiHhxifOsWWijBJ0RmMiTE9rG9XyLkwahJIcQ Sep 02 05:35:36.984884 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Id: None Sep 02 05:35:36.984884 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Name: None Sep 02 05:35:36.984884 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Identity-Status: Confirmed Sep 02 05:35:36.984884 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Is-Admin-Project: True Sep 02 05:35:36.984884 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Id: default Sep 02 05:35:36.984884 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Name: Default Sep 02 05:35:36.984884 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Id: 0847ca942df54b659e8723463ab72c65 Sep 02 05:35:36.984884 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Name: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:35:36.984884 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Role: member,reader Sep 02 05:35:36.984884 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Roles: member,reader Sep 02 05:35:36.986867 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0847ca942df54b659e8723463ab72c65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0847ca942df54b659e8723463ab72c65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0847ca942df54b659e8723463ab72c65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0847ca942df54b659e8723463ab72c65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:35:36.986867 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:35:36.986867 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Id: 0847ca942df54b659e8723463ab72c65 Sep 02 05:35:36.986867 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1685577678 Sep 02 05:35:36.986867 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User: tempest-AttachVolumeNegativeTest-1685577678-project Sep 02 05:35:36.986867 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Id: default Sep 02 05:35:36.986867 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Name: Default Sep 02 05:35:36.986867 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Id: ee1a3027b52f4b46bc5cff18f9cd0b02 Sep 02 05:35:36.986867 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Name: tempest-AttachVolumeNegativeTest-1685577678-project Sep 02 05:35:36.986867 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: method: > Sep 02 05:35:36.986867 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: exception: Instance 6ecefc31-2d93-4601-91e7-0d18da502d8b could not be found. Sep 02 05:35:36.986867 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: action_args: {'id': '6ecefc31-2d93-4601-91e7-0d18da502d8b'} Sep 02 05:35:36.987767 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:35:36.987767 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:35:36.987767 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:35:36.987767 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:35:36.987767 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:35:36.987767 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:35:36.987767 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:35:36.987767 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:35:36.987767 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:35:36.987767 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:35:36.987767 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ecefc31-2d93-4601-91e7-0d18da502d8b could not be found. Sep 02 05:35:36.987767 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:35:36.987767 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:35:36.987767 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:35:36.987767 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:35:36.987767 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:35:36.987767 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:35:36.987767 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:35:36.987767 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:35:36.987767 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:35:36.989266 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:35:36.989266 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:35:36.989266 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:35:36.989266 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:35:36.989266 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:35:36.989266 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:35:36.989266 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:35:36.989266 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ecefc31-2d93-4601-91e7-0d18da502d8b could not be found. Sep 02 05:35:36.989266 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:35:36.989266 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:35:36.989266 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:35:36.989266 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:35:36.989266 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:35:36.989266 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:35:36.989266 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:35:36.989266 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:35:36.989266 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ecefc31-2d93-4601-91e7-0d18da502d8b could not be found. Sep 02 05:35:36.989266 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:35:36.990580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-6842ee0c-e44b-412b-ab5e-f0a626cdceae tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] Returning 404 to user: Instance 6ecefc31-2d93-4601-91e7-0d18da502d8b could not be found. {{(pid=120448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:35:36.990580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-6842ee0c-e44b-412b-ab5e-f0a626cdceae tempest-AttachVolumeNegativeTest-1685577678 tempest-AttachVolumeNegativeTest-1685577678-project] 10.222.0.30 "GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b" status: 404 len: 111 microversion: 2.1 time: 0.034127 Sep 02 05:35:36.990580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 657/1316] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:35:36 2022] GET /compute/v2.1/servers/6ecefc31-2d93-4601-91e7-0d18da502d8b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:35:48.759530 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-b8d9af52-8c3d-41e6-b579-c98a4bbbc151 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:35:48.761790 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-b8d9af52-8c3d-41e6-b579-c98a4bbbc151 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:35:48.764636 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:35:48.765304 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:35:48.771041 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b8d9af52-8c3d-41e6-b579-c98a4bbbc151 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:48.771546 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b8d9af52-8c3d-41e6-b579-c98a4bbbc151 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:48.772004 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b8d9af52-8c3d-41e6-b579-c98a4bbbc151 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:48.772736 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b8d9af52-8c3d-41e6-b579-c98a4bbbc151 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:48.773187 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b8d9af52-8c3d-41e6-b579-c98a4bbbc151 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:48.773612 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b8d9af52-8c3d-41e6-b579-c98a4bbbc151 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:48.806037 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-b8d9af52-8c3d-41e6-b579-c98a4bbbc151 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050753 Sep 02 05:35:48.806618 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 660/1317] 10.222.0.30 () {60 vars in 1343 bytes} [Fri Sep 2 05:35:48 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:35:48.872715 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-a4919f28-ac39-42b5-8627-8589d709253b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:35:48.873314 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-a4919f28-ac39-42b5-8627-8589d709253b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:35:48.876504 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:35:48.877514 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:35:48.883500 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a4919f28-ac39-42b5-8627-8589d709253b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:48.883998 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a4919f28-ac39-42b5-8627-8589d709253b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:48.884540 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a4919f28-ac39-42b5-8627-8589d709253b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:48.885392 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a4919f28-ac39-42b5-8627-8589d709253b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:48.885841 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a4919f28-ac39-42b5-8627-8589d709253b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:48.886566 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-a4919f28-ac39-42b5-8627-8589d709253b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:48.913190 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-a4919f28-ac39-42b5-8627-8589d709253b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Going to try to terminate instance {{(pid=120448) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 05:35:49.009100 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-a4919f28-ac39-42b5-8627-8589d709253b tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 204 len: 0 microversion: 2.20 time: 0.141400 Sep 02 05:35:49.009605 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 658/1318] 10.222.0.30 () {60 vars in 1280 bytes} [Fri Sep 2 05:35:48 2022] DELETE /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 02 05:35:49.019656 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-8c5e3d30-c67a-4dc1-be48-46384b81a687 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:35:49.020386 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-8c5e3d30-c67a-4dc1-be48-46384b81a687 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:35:49.026438 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8c5e3d30-c67a-4dc1-be48-46384b81a687 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:49.026924 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8c5e3d30-c67a-4dc1-be48-46384b81a687 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:49.027359 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8c5e3d30-c67a-4dc1-be48-46384b81a687 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:49.028030 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8c5e3d30-c67a-4dc1-be48-46384b81a687 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:49.028499 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8c5e3d30-c67a-4dc1-be48-46384b81a687 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:49.028915 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8c5e3d30-c67a-4dc1-be48-46384b81a687 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:49.162250 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-8c5e3d30-c67a-4dc1-be48-46384b81a687 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:49.171136 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-8c5e3d30-c67a-4dc1-be48-46384b81a687 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:49.172589 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-8c5e3d30-c67a-4dc1-be48-46384b81a687 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:49.173746 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-8c5e3d30-c67a-4dc1-be48-46384b81a687 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1722 microversion: 2.20 time: 0.158064 Sep 02 05:35:49.174304 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 661/1319] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:35:49 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:35:50.202269 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-818864f0-10bd-4c2a-8f3e-df8b0bef2d5f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:35:50.203310 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-818864f0-10bd-4c2a-8f3e-df8b0bef2d5f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:35:50.214179 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-818864f0-10bd-4c2a-8f3e-df8b0bef2d5f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:50.214974 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-818864f0-10bd-4c2a-8f3e-df8b0bef2d5f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:50.215694 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-818864f0-10bd-4c2a-8f3e-df8b0bef2d5f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:50.216870 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-818864f0-10bd-4c2a-8f3e-df8b0bef2d5f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:50.217620 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-818864f0-10bd-4c2a-8f3e-df8b0bef2d5f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:50.218297 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-818864f0-10bd-4c2a-8f3e-df8b0bef2d5f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:50.352453 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-818864f0-10bd-4c2a-8f3e-df8b0bef2d5f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:50.360753 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-818864f0-10bd-4c2a-8f3e-df8b0bef2d5f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:50.362543 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-818864f0-10bd-4c2a-8f3e-df8b0bef2d5f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:50.363708 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-818864f0-10bd-4c2a-8f3e-df8b0bef2d5f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1722 microversion: 2.20 time: 0.168854 Sep 02 05:35:50.364289 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 659/1320] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:35:50 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:35:51.391229 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-d978b825-fe49-48dc-a577-7ec08d20487d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:35:51.391781 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-d978b825-fe49-48dc-a577-7ec08d20487d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:35:51.399556 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d978b825-fe49-48dc-a577-7ec08d20487d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:51.400057 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d978b825-fe49-48dc-a577-7ec08d20487d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:51.400594 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d978b825-fe49-48dc-a577-7ec08d20487d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:51.401292 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d978b825-fe49-48dc-a577-7ec08d20487d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:51.401965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d978b825-fe49-48dc-a577-7ec08d20487d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:51.402399 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d978b825-fe49-48dc-a577-7ec08d20487d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:51.545822 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-d978b825-fe49-48dc-a577-7ec08d20487d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:51.558071 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-d978b825-fe49-48dc-a577-7ec08d20487d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:51.560343 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-d978b825-fe49-48dc-a577-7ec08d20487d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:51.561766 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-d978b825-fe49-48dc-a577-7ec08d20487d tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1722 microversion: 2.20 time: 0.177359 Sep 02 05:35:51.562613 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 662/1321] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:35:51 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:35:52.587678 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-011179d8-d009-4eca-b350-2d4bb8d15e02 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:35:52.588585 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-011179d8-d009-4eca-b350-2d4bb8d15e02 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:35:52.597403 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-011179d8-d009-4eca-b350-2d4bb8d15e02 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:52.597890 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-011179d8-d009-4eca-b350-2d4bb8d15e02 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:52.598322 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-011179d8-d009-4eca-b350-2d4bb8d15e02 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:52.599010 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-011179d8-d009-4eca-b350-2d4bb8d15e02 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:52.599462 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-011179d8-d009-4eca-b350-2d4bb8d15e02 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:52.599887 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-011179d8-d009-4eca-b350-2d4bb8d15e02 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:52.734163 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-011179d8-d009-4eca-b350-2d4bb8d15e02 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:52.742961 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-011179d8-d009-4eca-b350-2d4bb8d15e02 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:52.744435 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-011179d8-d009-4eca-b350-2d4bb8d15e02 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:52.745635 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-011179d8-d009-4eca-b350-2d4bb8d15e02 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1722 microversion: 2.20 time: 0.164263 Sep 02 05:35:52.746199 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 660/1322] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:35:52 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:35:53.770422 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-54ff6bff-ecaa-444c-8a2c-b04a3aca0708 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:35:53.771091 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-54ff6bff-ecaa-444c-8a2c-b04a3aca0708 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:35:53.779154 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-54ff6bff-ecaa-444c-8a2c-b04a3aca0708 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:53.779711 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-54ff6bff-ecaa-444c-8a2c-b04a3aca0708 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:53.780249 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-54ff6bff-ecaa-444c-8a2c-b04a3aca0708 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:53.781065 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-54ff6bff-ecaa-444c-8a2c-b04a3aca0708 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:53.781579 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-54ff6bff-ecaa-444c-8a2c-b04a3aca0708 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:53.782132 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-54ff6bff-ecaa-444c-8a2c-b04a3aca0708 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:53.916935 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-54ff6bff-ecaa-444c-8a2c-b04a3aca0708 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:53.925372 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-54ff6bff-ecaa-444c-8a2c-b04a3aca0708 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:53.926805 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-54ff6bff-ecaa-444c-8a2c-b04a3aca0708 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:53.927966 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-54ff6bff-ecaa-444c-8a2c-b04a3aca0708 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1722 microversion: 2.20 time: 0.162190 Sep 02 05:35:53.928560 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 663/1323] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:35:53 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:35:54.955593 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-c2f9522b-f00f-4f8a-81a4-75dd6ad2663a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:35:54.956579 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-c2f9522b-f00f-4f8a-81a4-75dd6ad2663a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:35:54.968107 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c2f9522b-f00f-4f8a-81a4-75dd6ad2663a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:54.968971 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c2f9522b-f00f-4f8a-81a4-75dd6ad2663a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:54.969689 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c2f9522b-f00f-4f8a-81a4-75dd6ad2663a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:54.970895 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c2f9522b-f00f-4f8a-81a4-75dd6ad2663a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:54.971640 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c2f9522b-f00f-4f8a-81a4-75dd6ad2663a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:54.972379 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c2f9522b-f00f-4f8a-81a4-75dd6ad2663a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:55.117787 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c2f9522b-f00f-4f8a-81a4-75dd6ad2663a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:55.126231 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c2f9522b-f00f-4f8a-81a4-75dd6ad2663a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:55.127645 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c2f9522b-f00f-4f8a-81a4-75dd6ad2663a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:55.128835 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-c2f9522b-f00f-4f8a-81a4-75dd6ad2663a tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1722 microversion: 2.20 time: 0.180034 Sep 02 05:35:55.129367 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 661/1324] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:35:54 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:35:56.156232 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-057efc13-11ef-45ea-8ab2-5eb9979cb623 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:35:56.157255 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-057efc13-11ef-45ea-8ab2-5eb9979cb623 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:35:56.166992 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-057efc13-11ef-45ea-8ab2-5eb9979cb623 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:56.167466 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-057efc13-11ef-45ea-8ab2-5eb9979cb623 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:56.168014 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-057efc13-11ef-45ea-8ab2-5eb9979cb623 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:56.168766 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-057efc13-11ef-45ea-8ab2-5eb9979cb623 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:56.169466 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-057efc13-11ef-45ea-8ab2-5eb9979cb623 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:56.170143 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-057efc13-11ef-45ea-8ab2-5eb9979cb623 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:56.306736 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-057efc13-11ef-45ea-8ab2-5eb9979cb623 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:56.320652 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-057efc13-11ef-45ea-8ab2-5eb9979cb623 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:56.323010 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-057efc13-11ef-45ea-8ab2-5eb9979cb623 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:56.324966 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-057efc13-11ef-45ea-8ab2-5eb9979cb623 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1722 microversion: 2.20 time: 0.174910 Sep 02 05:35:56.325658 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 664/1325] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:35:56 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:35:57.353798 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-ed2a5717-799f-4687-b032-013ea4ddc158 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:35:57.354731 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-ed2a5717-799f-4687-b032-013ea4ddc158 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:35:57.365846 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ed2a5717-799f-4687-b032-013ea4ddc158 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:57.366627 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ed2a5717-799f-4687-b032-013ea4ddc158 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:57.367333 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ed2a5717-799f-4687-b032-013ea4ddc158 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:57.368519 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ed2a5717-799f-4687-b032-013ea4ddc158 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:57.369264 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ed2a5717-799f-4687-b032-013ea4ddc158 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:57.369951 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-ed2a5717-799f-4687-b032-013ea4ddc158 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:57.516540 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-ed2a5717-799f-4687-b032-013ea4ddc158 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:57.525649 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-ed2a5717-799f-4687-b032-013ea4ddc158 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:57.527072 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-ed2a5717-799f-4687-b032-013ea4ddc158 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:57.528283 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-ed2a5717-799f-4687-b032-013ea4ddc158 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1722 microversion: 2.20 time: 0.180960 Sep 02 05:35:57.528857 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 662/1326] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:35:57 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:35:58.551398 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-e2a2152e-a4f0-407c-be76-9b167335bd0c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:35:58.552004 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-e2a2152e-a4f0-407c-be76-9b167335bd0c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:35:58.558777 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e2a2152e-a4f0-407c-be76-9b167335bd0c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:58.559246 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e2a2152e-a4f0-407c-be76-9b167335bd0c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:58.559675 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e2a2152e-a4f0-407c-be76-9b167335bd0c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:58.560395 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e2a2152e-a4f0-407c-be76-9b167335bd0c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:58.560958 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e2a2152e-a4f0-407c-be76-9b167335bd0c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:58.561376 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e2a2152e-a4f0-407c-be76-9b167335bd0c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:58.693209 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e2a2152e-a4f0-407c-be76-9b167335bd0c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:58.701791 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e2a2152e-a4f0-407c-be76-9b167335bd0c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:58.703254 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-e2a2152e-a4f0-407c-be76-9b167335bd0c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:58.704446 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-e2a2152e-a4f0-407c-be76-9b167335bd0c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1722 microversion: 2.20 time: 0.157029 Sep 02 05:35:58.704999 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 665/1327] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:35:58 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:35:59.251410 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-7bd2a94f-fc5d-456f-9d4d-fecbe1aa3501 req-84543cdd-9340-4caf-a07b-ca3832b4a061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d862d87f-85bc-4970-97b5-af0ff1b6ebf8", "name": "network-vif-deleted", "tag": "47f28e65-04e5-4573-84d6-9faa45a85dd1"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:35:59.263169 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-7bd2a94f-fc5d-456f-9d4d-fecbe1aa3501 req-84543cdd-9340-4caf-a07b-ca3832b4a061 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:59.263654 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-7bd2a94f-fc5d-456f-9d4d-fecbe1aa3501 req-84543cdd-9340-4caf-a07b-ca3832b4a061 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:59.264090 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-7bd2a94f-fc5d-456f-9d4d-fecbe1aa3501 req-84543cdd-9340-4caf-a07b-ca3832b4a061 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:59.278580 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-7bd2a94f-fc5d-456f-9d4d-fecbe1aa3501 req-84543cdd-9340-4caf-a07b-ca3832b4a061 service nova] Creating event network-vif-deleted:47f28e65-04e5-4573-84d6-9faa45a85dd1 for instance d862d87f-85bc-4970-97b5-af0ff1b6ebf8 on hv-cinder-85391 Sep 02 05:35:59.285311 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-7bd2a94f-fc5d-456f-9d4d-fecbe1aa3501 req-84543cdd-9340-4caf-a07b-ca3832b4a061 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037971 Sep 02 05:35:59.289659 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 663/1328] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:35:59.727041 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-bf6b6a65-ea46-4043-baa0-210c6d85fd39 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:35:59.727602 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-bf6b6a65-ea46-4043-baa0-210c6d85fd39 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:35:59.734654 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bf6b6a65-ea46-4043-baa0-210c6d85fd39 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:59.735137 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bf6b6a65-ea46-4043-baa0-210c6d85fd39 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:59.735621 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bf6b6a65-ea46-4043-baa0-210c6d85fd39 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:59.736698 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bf6b6a65-ea46-4043-baa0-210c6d85fd39 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:59.737156 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bf6b6a65-ea46-4043-baa0-210c6d85fd39 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:59.737575 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bf6b6a65-ea46-4043-baa0-210c6d85fd39 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:59.768690 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bf6b6a65-ea46-4043-baa0-210c6d85fd39 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:35:59.769172 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bf6b6a65-ea46-4043-baa0-210c6d85fd39 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:35:59.769597 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bf6b6a65-ea46-4043-baa0-210c6d85fd39 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:35:59.770042 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.objects.instance [None req-bf6b6a65-ea46-4043-baa0-210c6d85fd39 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lazy-loading 'fault' on Instance uuid d862d87f-85bc-4970-97b5-af0ff1b6ebf8 {{(pid=120449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:35:59.815112 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-bf6b6a65-ea46-4043-baa0-210c6d85fd39 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:59.823797 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-bf6b6a65-ea46-4043-baa0-210c6d85fd39 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:59.825263 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-bf6b6a65-ea46-4043-baa0-210c6d85fd39 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47ca04b60554047b0541de359bafd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ca1d5cfab24589b53707dea9790e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:35:59.826393 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-bf6b6a65-ea46-4043-baa0-210c6d85fd39 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 200 len: 1370 microversion: 2.20 time: 0.103316 Sep 02 05:35:59.826953 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 666/1329] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:35:59 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 1370 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 05:36:00.857371 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-6b424aea-a34d-4542-8499-cb08854a3ea7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:00.858488 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-6b424aea-a34d-4542-8499-cb08854a3ea7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:00.869959 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6b424aea-a34d-4542-8499-cb08854a3ea7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:00.870751 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6b424aea-a34d-4542-8499-cb08854a3ea7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:00.871470 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6b424aea-a34d-4542-8499-cb08854a3ea7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:00.872658 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6b424aea-a34d-4542-8499-cb08854a3ea7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:00.873406 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6b424aea-a34d-4542-8499-cb08854a3ea7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:00.874101 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6b424aea-a34d-4542-8499-cb08854a3ea7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:00.888994 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.wsgi [None req-6b424aea-a34d-4542-8499-cb08854a3ea7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] HTTP exception thrown: Instance d862d87f-85bc-4970-97b5-af0ff1b6ebf8 could not be found. Sep 02 05:36:00.890606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-6b424aea-a34d-4542-8499-cb08854a3ea7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Request method failure captured: Sep 02 05:36:00.890606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: request: GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 HTTP/1.1 Sep 02 05:36:00.890606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept: application/json Sep 02 05:36:00.890606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept-Encoding: identity Sep 02 05:36:00.890606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Connection: close Sep 02 05:36:00.890606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Length: 0 Sep 02 05:36:00.890606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Type: application/json Sep 02 05:36:00.890606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Host: 10.222.0.30 Sep 02 05:36:00.890606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Openstack-System-Scope: None Sep 02 05:36:00.890606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: User-Agent: python-urllib3/1.26.12 Sep 02 05:36:00.890606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Auth-Token: gAAAAABjEZNHHK1IbaiBqBFmA-MnaPh2VqL5ADErh1ykHe-RFz6tId62cDWk6A0VQdlbG6jfmhnj88mSUBoVxx4qtnBjnjsYvT1POjPXTTvBEN6YFEtMftnpId532hIiXEdegWNs7gxD33mKm9D6aagYTbOPubYtBX6NgvZXsF9xl9gQoUzpGTs Sep 02 05:36:00.890606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Id: None Sep 02 05:36:00.890606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Name: None Sep 02 05:36:00.890606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Identity-Status: Confirmed Sep 02 05:36:00.890606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Is-Admin-Project: True Sep 02 05:36:00.890606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Openstack-Nova-Api-Version: 2.20 Sep 02 05:36:00.890606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Id: default Sep 02 05:36:00.890606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Name: Default Sep 02 05:36:00.890606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Id: 11ca1d5cfab24589b53707dea9790e26 Sep 02 05:36:00.890606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-151451576 Sep 02 05:36:00.890606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Role: member,reader Sep 02 05:36:00.890606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Roles: member,reader Sep 02 05:36:00.892344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_11ca1d5cfab24589b53707dea9790e26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11ca1d5cfab24589b53707dea9790e26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/11ca1d5cfab24589b53707dea9790e26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11ca1d5cfab24589b53707dea9790e26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:36:00.892344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant: tempest-AttachVolumeShelveTestJSON-151451576 Sep 02 05:36:00.892344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Id: 11ca1d5cfab24589b53707dea9790e26 Sep 02 05:36:00.892344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-151451576 Sep 02 05:36:00.892344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User: tempest-AttachVolumeShelveTestJSON-151451576-project Sep 02 05:36:00.892344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Id: default Sep 02 05:36:00.892344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Name: Default Sep 02 05:36:00.892344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Id: f47ca04b60554047b0541de359bafd26 Sep 02 05:36:00.892344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Name: tempest-AttachVolumeShelveTestJSON-151451576-project Sep 02 05:36:00.892344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: method: > Sep 02 05:36:00.892344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: exception: Instance d862d87f-85bc-4970-97b5-af0ff1b6ebf8 could not be found. Sep 02 05:36:00.892344 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: action_args: {'id': 'd862d87f-85bc-4970-97b5-af0ff1b6ebf8'} Sep 02 05:36:00.893307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:36:00.893307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:36:00.893307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:36:00.893307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:36:00.893307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:36:00.893307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:36:00.893307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:36:00.893307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:36:00.893307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:36:00.893307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:36:00.893307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d862d87f-85bc-4970-97b5-af0ff1b6ebf8 could not be found. Sep 02 05:36:00.893307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:36:00.893307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:36:00.893307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:36:00.893307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:36:00.893307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:36:00.893307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:36:00.893307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:36:00.893307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:36:00.893307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:36:00.894955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:36:00.894955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:36:00.894955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:36:00.894955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:36:00.894955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:36:00.894955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:36:00.894955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:36:00.894955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d862d87f-85bc-4970-97b5-af0ff1b6ebf8 could not be found. Sep 02 05:36:00.894955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:36:00.894955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:36:00.894955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:36:00.894955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:36:00.894955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:36:00.894955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:36:00.894955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:36:00.894955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:36:00.894955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d862d87f-85bc-4970-97b5-af0ff1b6ebf8 could not be found. Sep 02 05:36:00.894955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:36:00.896601 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-6b424aea-a34d-4542-8499-cb08854a3ea7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Returning 404 to user: Instance d862d87f-85bc-4970-97b5-af0ff1b6ebf8 could not be found. {{(pid=120448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:36:00.896601 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-6b424aea-a34d-4542-8499-cb08854a3ea7 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 404 len: 111 microversion: 2.20 time: 0.041841 Sep 02 05:36:00.896601 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 664/1330] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:36:00 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 02 05:36:00.901339 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-dd13df3c-6ed1-4ce4-bf36-372621f3674c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '.version_select at 0x7fc90b4da550>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:00.905958 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dd13df3c-6ed1-4ce4-bf36-372621f3674c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [0d827ea1-3cba-488b-b42c-f7d5141c8278] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 02 05:36:01.914708 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO oslo.messaging._drivers.impl_rabbit [None req-dd13df3c-6ed1-4ce4-bf36-372621f3674c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [0d827ea1-3cba-488b-b42c-f7d5141c8278] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 55142. Sep 02 05:36:01.936543 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-dd13df3c-6ed1-4ce4-bf36-372621f3674c tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-92141164" status: 204 len: 0 microversion: 2.20 time: 1.039159 Sep 02 05:36:01.937137 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 667/1331] 10.222.0.30 () {60 vars in 1256 bytes} [Fri Sep 2 05:36:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-92141164 => generated 0 bytes in 1040 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 02 05:36:04.775939 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-8647724c-1fc8-4e28-9f91-46b5060c4a75 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:04.776612 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-8647724c-1fc8-4e28-9f91-46b5060c4a75 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:04.784433 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8647724c-1fc8-4e28-9f91-46b5060c4a75 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:04.784818 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8647724c-1fc8-4e28-9f91-46b5060c4a75 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:04.785246 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8647724c-1fc8-4e28-9f91-46b5060c4a75 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:04.785940 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8647724c-1fc8-4e28-9f91-46b5060c4a75 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:04.786506 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8647724c-1fc8-4e28-9f91-46b5060c4a75 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:04.786950 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8647724c-1fc8-4e28-9f91-46b5060c4a75 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:04.801211 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.wsgi [None req-8647724c-1fc8-4e28-9f91-46b5060c4a75 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] HTTP exception thrown: Instance d862d87f-85bc-4970-97b5-af0ff1b6ebf8 could not be found. Sep 02 05:36:04.802807 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-8647724c-1fc8-4e28-9f91-46b5060c4a75 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Request method failure captured: Sep 02 05:36:04.802807 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: request: DELETE /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 HTTP/1.1 Sep 02 05:36:04.802807 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept: application/json Sep 02 05:36:04.802807 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept-Encoding: identity Sep 02 05:36:04.802807 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Connection: close Sep 02 05:36:04.802807 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Length: 0 Sep 02 05:36:04.802807 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Type: application/json Sep 02 05:36:04.802807 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Host: 10.222.0.30 Sep 02 05:36:04.802807 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Openstack-System-Scope: None Sep 02 05:36:04.802807 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: User-Agent: python-urllib3/1.26.12 Sep 02 05:36:04.802807 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Auth-Token: gAAAAABjEZNHHK1IbaiBqBFmA-MnaPh2VqL5ADErh1ykHe-RFz6tId62cDWk6A0VQdlbG6jfmhnj88mSUBoVxx4qtnBjnjsYvT1POjPXTTvBEN6YFEtMftnpId532hIiXEdegWNs7gxD33mKm9D6aagYTbOPubYtBX6NgvZXsF9xl9gQoUzpGTs Sep 02 05:36:04.802807 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Id: None Sep 02 05:36:04.802807 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Name: None Sep 02 05:36:04.802807 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Identity-Status: Confirmed Sep 02 05:36:04.802807 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Is-Admin-Project: True Sep 02 05:36:04.802807 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Openstack-Nova-Api-Version: 2.20 Sep 02 05:36:04.802807 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Id: default Sep 02 05:36:04.802807 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Name: Default Sep 02 05:36:04.802807 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Id: 11ca1d5cfab24589b53707dea9790e26 Sep 02 05:36:04.802807 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-151451576 Sep 02 05:36:04.802807 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Role: member,reader Sep 02 05:36:04.802807 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Roles: member,reader Sep 02 05:36:04.809117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_11ca1d5cfab24589b53707dea9790e26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11ca1d5cfab24589b53707dea9790e26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/11ca1d5cfab24589b53707dea9790e26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11ca1d5cfab24589b53707dea9790e26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:36:04.809117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant: tempest-AttachVolumeShelveTestJSON-151451576 Sep 02 05:36:04.809117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Id: 11ca1d5cfab24589b53707dea9790e26 Sep 02 05:36:04.809117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-151451576 Sep 02 05:36:04.809117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User: tempest-AttachVolumeShelveTestJSON-151451576-project Sep 02 05:36:04.809117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Id: default Sep 02 05:36:04.809117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Name: Default Sep 02 05:36:04.809117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Id: f47ca04b60554047b0541de359bafd26 Sep 02 05:36:04.809117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Name: tempest-AttachVolumeShelveTestJSON-151451576-project Sep 02 05:36:04.809117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: method: > Sep 02 05:36:04.809117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: exception: Instance d862d87f-85bc-4970-97b5-af0ff1b6ebf8 could not be found. Sep 02 05:36:04.809117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: action_args: {'id': 'd862d87f-85bc-4970-97b5-af0ff1b6ebf8'} Sep 02 05:36:04.810117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:36:04.810117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:36:04.810117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:36:04.810117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:36:04.810117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:36:04.810117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:36:04.810117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:36:04.810117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:36:04.810117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:36:04.810117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:36:04.810117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d862d87f-85bc-4970-97b5-af0ff1b6ebf8 could not be found. Sep 02 05:36:04.810117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:36:04.810117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:36:04.810117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:36:04.810117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:36:04.810117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:36:04.810117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:36:04.810117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:36:04.810117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:36:04.810117 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:36:04.811431 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:36:04.811431 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 05:36:04.811431 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 05:36:04.811431 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 05:36:04.811431 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 05:36:04.811431 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:36:04.811431 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:36:04.811431 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:36:04.811431 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:36:04.811431 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d862d87f-85bc-4970-97b5-af0ff1b6ebf8 could not be found. Sep 02 05:36:04.811431 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:36:04.811431 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:36:04.811431 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:36:04.811431 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:36:04.811431 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:36:04.811431 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:36:04.811431 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:36:04.811431 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:36:04.811431 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d862d87f-85bc-4970-97b5-af0ff1b6ebf8 could not be found. Sep 02 05:36:04.811431 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:36:04.812735 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-8647724c-1fc8-4e28-9f91-46b5060c4a75 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Returning 404 to user: Instance d862d87f-85bc-4970-97b5-af0ff1b6ebf8 could not be found. {{(pid=120448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:36:04.812735 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-8647724c-1fc8-4e28-9f91-46b5060c4a75 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 404 len: 111 microversion: 2.20 time: 0.032173 Sep 02 05:36:04.812735 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 665/1332] 10.222.0.30 () {60 vars in 1280 bytes} [Fri Sep 2 05:36:04 2022] DELETE /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 02 05:36:04.813929 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-fa8e0542-50d8-4001-b531-5bc70d9353a5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:04.814408 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-05ec0126-33c0-4970-a6a1-4cfc220ed5dd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-551767304", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1280367057", "security_groups": [{"name": "tempest-secgroup-smoke-609092212"}], "block_device_mapping_v2": [{"uuid": "25255173-f9d3-4079-ac57-33b08aef4c6f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8d5e3ffd-1ee0-4cbd-8c2c-83ff33c46dbd"}]}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:36:04.815321 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-fa8e0542-50d8-4001-b531-5bc70d9353a5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: d862d87f-85bc-4970-97b5-af0ff1b6ebf8] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:04.822126 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fa8e0542-50d8-4001-b531-5bc70d9353a5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:04.822590 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fa8e0542-50d8-4001-b531-5bc70d9353a5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:04.823025 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fa8e0542-50d8-4001-b531-5bc70d9353a5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:04.823722 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fa8e0542-50d8-4001-b531-5bc70d9353a5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:04.824196 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fa8e0542-50d8-4001-b531-5bc70d9353a5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:04.824635 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-fa8e0542-50d8-4001-b531-5bc70d9353a5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:04.838528 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.wsgi [None req-fa8e0542-50d8-4001-b531-5bc70d9353a5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] HTTP exception thrown: Instance d862d87f-85bc-4970-97b5-af0ff1b6ebf8 could not be found. Sep 02 05:36:04.839986 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-fa8e0542-50d8-4001-b531-5bc70d9353a5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Request method failure captured: Sep 02 05:36:04.839986 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: request: GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 HTTP/1.1 Sep 02 05:36:04.839986 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept: application/json Sep 02 05:36:04.839986 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept-Encoding: identity Sep 02 05:36:04.839986 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Connection: close Sep 02 05:36:04.839986 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Length: 0 Sep 02 05:36:04.839986 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Type: application/json Sep 02 05:36:04.839986 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Host: 10.222.0.30 Sep 02 05:36:04.839986 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Openstack-System-Scope: None Sep 02 05:36:04.839986 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: User-Agent: python-urllib3/1.26.12 Sep 02 05:36:04.839986 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Auth-Token: gAAAAABjEZNHHK1IbaiBqBFmA-MnaPh2VqL5ADErh1ykHe-RFz6tId62cDWk6A0VQdlbG6jfmhnj88mSUBoVxx4qtnBjnjsYvT1POjPXTTvBEN6YFEtMftnpId532hIiXEdegWNs7gxD33mKm9D6aagYTbOPubYtBX6NgvZXsF9xl9gQoUzpGTs Sep 02 05:36:04.839986 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Id: None Sep 02 05:36:04.839986 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Name: None Sep 02 05:36:04.839986 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Identity-Status: Confirmed Sep 02 05:36:04.839986 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Is-Admin-Project: True Sep 02 05:36:04.839986 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Openstack-Nova-Api-Version: 2.20 Sep 02 05:36:04.839986 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Id: default Sep 02 05:36:04.839986 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Name: Default Sep 02 05:36:04.839986 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Id: 11ca1d5cfab24589b53707dea9790e26 Sep 02 05:36:04.839986 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-151451576 Sep 02 05:36:04.839986 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Role: member,reader Sep 02 05:36:04.839986 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Roles: member,reader Sep 02 05:36:04.841467 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_11ca1d5cfab24589b53707dea9790e26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11ca1d5cfab24589b53707dea9790e26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/11ca1d5cfab24589b53707dea9790e26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11ca1d5cfab24589b53707dea9790e26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:36:04.841467 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant: tempest-AttachVolumeShelveTestJSON-151451576 Sep 02 05:36:04.841467 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Id: 11ca1d5cfab24589b53707dea9790e26 Sep 02 05:36:04.841467 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-151451576 Sep 02 05:36:04.841467 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User: tempest-AttachVolumeShelveTestJSON-151451576-project Sep 02 05:36:04.841467 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Id: default Sep 02 05:36:04.841467 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Name: Default Sep 02 05:36:04.841467 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Id: f47ca04b60554047b0541de359bafd26 Sep 02 05:36:04.841467 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Name: tempest-AttachVolumeShelveTestJSON-151451576-project Sep 02 05:36:04.841467 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: method: > Sep 02 05:36:04.841467 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: exception: Instance d862d87f-85bc-4970-97b5-af0ff1b6ebf8 could not be found. Sep 02 05:36:04.841467 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: action_args: {'id': 'd862d87f-85bc-4970-97b5-af0ff1b6ebf8'} Sep 02 05:36:04.842277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:36:04.842277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:36:04.842277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:36:04.842277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:36:04.842277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:36:04.842277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:36:04.842277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:36:04.842277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:36:04.842277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:36:04.842277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:36:04.842277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d862d87f-85bc-4970-97b5-af0ff1b6ebf8 could not be found. Sep 02 05:36:04.842277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:36:04.842277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:36:04.842277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:36:04.842277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:36:04.842277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:36:04.842277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:36:04.842277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:36:04.842277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:36:04.842277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:36:04.843587 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:36:04.843587 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:36:04.843587 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:36:04.843587 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:36:04.843587 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:36:04.843587 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:36:04.843587 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:36:04.843587 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d862d87f-85bc-4970-97b5-af0ff1b6ebf8 could not be found. Sep 02 05:36:04.843587 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:36:04.843587 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:36:04.843587 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:36:04.843587 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:36:04.843587 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:36:04.843587 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:36:04.843587 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:36:04.843587 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:36:04.843587 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d862d87f-85bc-4970-97b5-af0ff1b6ebf8 could not be found. Sep 02 05:36:04.843587 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:36:04.844776 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-fa8e0542-50d8-4001-b531-5bc70d9353a5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Returning 404 to user: Instance d862d87f-85bc-4970-97b5-af0ff1b6ebf8 could not be found. {{(pid=120449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:36:04.844776 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-fa8e0542-50d8-4001-b531-5bc70d9353a5 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8" status: 404 len: 111 microversion: 2.20 time: 0.031881 Sep 02 05:36:04.844776 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 668/1333] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:36:04 2022] GET /compute/v2.1/servers/d862d87f-85bc-4970-97b5-af0ff1b6ebf8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 02 05:36:04.939562 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.network.neutron [None req-05ec0126-33c0-4970-a6a1-4cfc220ed5dd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] validate_networks() for [('8d5e3ffd-1ee0-4cbd-8c2c-83ff33c46dbd', None, None, None, None, None)] {{(pid=120448) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 05:36:05.444237 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-05ec0126-33c0-4970-a6a1-4cfc220ed5dd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Flavor limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 05:36:05.444765 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-05ec0126-33c0-4970-a6a1-4cfc220ed5dd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Image limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 05:36:05.445246 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-05ec0126-33c0-4970-a6a1-4cfc220ed5dd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Flavor pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 05:36:05.445651 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-05ec0126-33c0-4970-a6a1-4cfc220ed5dd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Image pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 05:36:05.446058 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-05ec0126-33c0-4970-a6a1-4cfc220ed5dd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 05:36:05.455277 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-05ec0126-33c0-4970-a6a1-4cfc220ed5dd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:05.455757 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-05ec0126-33c0-4970-a6a1-4cfc220ed5dd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:05.456231 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-05ec0126-33c0-4970-a6a1-4cfc220ed5dd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:05.456954 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-05ec0126-33c0-4970-a6a1-4cfc220ed5dd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:05.457406 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-05ec0126-33c0-4970-a6a1-4cfc220ed5dd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:05.457824 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-05ec0126-33c0-4970-a6a1-4cfc220ed5dd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:05.475137 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-05ec0126-33c0-4970-a6a1-4cfc220ed5dd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Getting quotas for project e45a42292fe94dccaa14ba6bc41ded09. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:36:05.479307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-05ec0126-33c0-4970-a6a1-4cfc220ed5dd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Getting quotas for user 03812cff7628436f952ea5be41420297 and project e45a42292fe94dccaa14ba6bc41ded09. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:36:05.542806 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-05ec0126-33c0-4970-a6a1-4cfc220ed5dd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Going to run 1 instances... {{(pid=120448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 05:36:05.545050 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-05ec0126-33c0-4970-a6a1-4cfc220ed5dd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b1aa5cbd-af79-4606-8187-fb835b9bb05d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='25255173-f9d3-4079-ac57-33b08aef4c6f',volume_size=None,volume_type=None)] {{(pid=120448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 05:36:05.692173 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-05ec0126-33c0-4970-a6a1-4cfc220ed5dd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.881745 Sep 02 05:36:05.693113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 666/1334] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Sep 2 05:36:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 05:36:05.704390 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-8e6f2c6f-2a2b-43d9-8580-abe2200f9cd0 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:05.705007 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-8e6f2c6f-2a2b-43d9-8580-abe2200f9cd0 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b1aa5cbd-af79-4606-8187-fb835b9bb05d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:05.759876 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-8e6f2c6f-2a2b-43d9-8580-abe2200f9cd0 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:05.767775 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-8e6f2c6f-2a2b-43d9-8580-abe2200f9cd0 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d" status: 200 len: 1094 microversion: 2.1 time: 0.067414 Sep 02 05:36:05.768339 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 669/1335] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:05 2022] GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:05.999254 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-9910ad8f-c954-4df8-8b16-e02dc315fe26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:06.000283 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-9910ad8f-c954-4df8-8b16-e02dc315fe26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:06.010297 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9910ad8f-c954-4df8-8b16-e02dc315fe26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:06.010783 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9910ad8f-c954-4df8-8b16-e02dc315fe26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:06.011183 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9910ad8f-c954-4df8-8b16-e02dc315fe26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:06.011875 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9910ad8f-c954-4df8-8b16-e02dc315fe26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:06.012359 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9910ad8f-c954-4df8-8b16-e02dc315fe26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:06.012772 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-9910ad8f-c954-4df8-8b16-e02dc315fe26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:06.027876 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.wsgi [None req-9910ad8f-c954-4df8-8b16-e02dc315fe26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] HTTP exception thrown: Instance 1e32b402-d6f2-4861-a864-005e1a9f808d could not be found. Sep 02 05:36:06.029691 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-9910ad8f-c954-4df8-8b16-e02dc315fe26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Request method failure captured: Sep 02 05:36:06.029691 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: request: DELETE /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d HTTP/1.1 Sep 02 05:36:06.029691 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept: application/json Sep 02 05:36:06.029691 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept-Encoding: identity Sep 02 05:36:06.029691 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Connection: close Sep 02 05:36:06.029691 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Length: 0 Sep 02 05:36:06.029691 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Type: application/json Sep 02 05:36:06.029691 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Host: 10.222.0.30 Sep 02 05:36:06.029691 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Openstack-System-Scope: None Sep 02 05:36:06.029691 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: User-Agent: python-urllib3/1.26.12 Sep 02 05:36:06.029691 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Auth-Token: gAAAAABjEZNHHK1IbaiBqBFmA-MnaPh2VqL5ADErh1ykHe-RFz6tId62cDWk6A0VQdlbG6jfmhnj88mSUBoVxx4qtnBjnjsYvT1POjPXTTvBEN6YFEtMftnpId532hIiXEdegWNs7gxD33mKm9D6aagYTbOPubYtBX6NgvZXsF9xl9gQoUzpGTs Sep 02 05:36:06.029691 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Id: None Sep 02 05:36:06.029691 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Name: None Sep 02 05:36:06.029691 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Identity-Status: Confirmed Sep 02 05:36:06.029691 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Is-Admin-Project: True Sep 02 05:36:06.029691 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Openstack-Nova-Api-Version: 2.20 Sep 02 05:36:06.029691 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Id: default Sep 02 05:36:06.029691 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Name: Default Sep 02 05:36:06.029691 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Id: 11ca1d5cfab24589b53707dea9790e26 Sep 02 05:36:06.029691 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-151451576 Sep 02 05:36:06.029691 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Role: member,reader Sep 02 05:36:06.029691 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Roles: member,reader Sep 02 05:36:06.031336 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_11ca1d5cfab24589b53707dea9790e26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11ca1d5cfab24589b53707dea9790e26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/11ca1d5cfab24589b53707dea9790e26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11ca1d5cfab24589b53707dea9790e26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:36:06.031336 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant: tempest-AttachVolumeShelveTestJSON-151451576 Sep 02 05:36:06.031336 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Id: 11ca1d5cfab24589b53707dea9790e26 Sep 02 05:36:06.031336 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-151451576 Sep 02 05:36:06.031336 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User: tempest-AttachVolumeShelveTestJSON-151451576-project Sep 02 05:36:06.031336 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Id: default Sep 02 05:36:06.031336 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Name: Default Sep 02 05:36:06.031336 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Id: f47ca04b60554047b0541de359bafd26 Sep 02 05:36:06.031336 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Name: tempest-AttachVolumeShelveTestJSON-151451576-project Sep 02 05:36:06.031336 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: method: > Sep 02 05:36:06.031336 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: exception: Instance 1e32b402-d6f2-4861-a864-005e1a9f808d could not be found. Sep 02 05:36:06.031336 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: action_args: {'id': '1e32b402-d6f2-4861-a864-005e1a9f808d'} Sep 02 05:36:06.032285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:36:06.032285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:36:06.032285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:36:06.032285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:36:06.032285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:36:06.032285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:36:06.032285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:36:06.032285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:36:06.032285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:36:06.032285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:36:06.032285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e32b402-d6f2-4861-a864-005e1a9f808d could not be found. Sep 02 05:36:06.032285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:36:06.032285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:36:06.032285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:36:06.032285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:36:06.032285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:36:06.032285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:36:06.032285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:36:06.032285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:36:06.032285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:36:06.033626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:36:06.033626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 05:36:06.033626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 05:36:06.033626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 05:36:06.033626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 05:36:06.033626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:36:06.033626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:36:06.033626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:36:06.033626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:36:06.033626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e32b402-d6f2-4861-a864-005e1a9f808d could not be found. Sep 02 05:36:06.033626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:36:06.033626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:36:06.033626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:36:06.033626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:36:06.033626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:36:06.033626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:36:06.033626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:36:06.033626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:36:06.033626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e32b402-d6f2-4861-a864-005e1a9f808d could not be found. Sep 02 05:36:06.033626 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:36:06.034947 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-9910ad8f-c954-4df8-8b16-e02dc315fe26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Returning 404 to user: Instance 1e32b402-d6f2-4861-a864-005e1a9f808d could not be found. {{(pid=120448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:36:06.034947 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-9910ad8f-c954-4df8-8b16-e02dc315fe26 tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 404 len: 111 microversion: 2.20 time: 0.037618 Sep 02 05:36:06.034947 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 667/1336] 10.222.0.30 () {60 vars in 1280 bytes} [Fri Sep 2 05:36:05 2022] DELETE /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 02 05:36:06.043137 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-d244fc72-fa25-42fa-9932-faa7063e522f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:06.043752 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-d244fc72-fa25-42fa-9932-faa7063e522f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] [instance: 1e32b402-d6f2-4861-a864-005e1a9f808d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:06.051426 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d244fc72-fa25-42fa-9932-faa7063e522f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:06.051758 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d244fc72-fa25-42fa-9932-faa7063e522f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:06.052220 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d244fc72-fa25-42fa-9932-faa7063e522f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:06.052917 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d244fc72-fa25-42fa-9932-faa7063e522f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:06.053368 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d244fc72-fa25-42fa-9932-faa7063e522f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:06.053788 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d244fc72-fa25-42fa-9932-faa7063e522f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:06.069344 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.wsgi [None req-d244fc72-fa25-42fa-9932-faa7063e522f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] HTTP exception thrown: Instance 1e32b402-d6f2-4861-a864-005e1a9f808d could not be found. Sep 02 05:36:06.070883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-d244fc72-fa25-42fa-9932-faa7063e522f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Request method failure captured: Sep 02 05:36:06.070883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: request: GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d HTTP/1.1 Sep 02 05:36:06.070883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept: application/json Sep 02 05:36:06.070883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept-Encoding: identity Sep 02 05:36:06.070883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Connection: close Sep 02 05:36:06.070883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Length: 0 Sep 02 05:36:06.070883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Type: application/json Sep 02 05:36:06.070883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Host: 10.222.0.30 Sep 02 05:36:06.070883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Openstack-System-Scope: None Sep 02 05:36:06.070883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: User-Agent: python-urllib3/1.26.12 Sep 02 05:36:06.070883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Auth-Token: gAAAAABjEZNHHK1IbaiBqBFmA-MnaPh2VqL5ADErh1ykHe-RFz6tId62cDWk6A0VQdlbG6jfmhnj88mSUBoVxx4qtnBjnjsYvT1POjPXTTvBEN6YFEtMftnpId532hIiXEdegWNs7gxD33mKm9D6aagYTbOPubYtBX6NgvZXsF9xl9gQoUzpGTs Sep 02 05:36:06.070883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Id: None Sep 02 05:36:06.070883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Name: None Sep 02 05:36:06.070883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Identity-Status: Confirmed Sep 02 05:36:06.070883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Is-Admin-Project: True Sep 02 05:36:06.070883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Openstack-Nova-Api-Version: 2.20 Sep 02 05:36:06.070883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Id: default Sep 02 05:36:06.070883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Name: Default Sep 02 05:36:06.070883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Id: 11ca1d5cfab24589b53707dea9790e26 Sep 02 05:36:06.070883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-151451576 Sep 02 05:36:06.070883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Role: member,reader Sep 02 05:36:06.070883 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Roles: member,reader Sep 02 05:36:06.072819 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_11ca1d5cfab24589b53707dea9790e26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11ca1d5cfab24589b53707dea9790e26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/11ca1d5cfab24589b53707dea9790e26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11ca1d5cfab24589b53707dea9790e26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:36:06.072819 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant: tempest-AttachVolumeShelveTestJSON-151451576 Sep 02 05:36:06.072819 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Id: 11ca1d5cfab24589b53707dea9790e26 Sep 02 05:36:06.072819 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-151451576 Sep 02 05:36:06.072819 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User: tempest-AttachVolumeShelveTestJSON-151451576-project Sep 02 05:36:06.072819 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Id: default Sep 02 05:36:06.072819 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Name: Default Sep 02 05:36:06.072819 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Id: f47ca04b60554047b0541de359bafd26 Sep 02 05:36:06.072819 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Name: tempest-AttachVolumeShelveTestJSON-151451576-project Sep 02 05:36:06.072819 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: method: > Sep 02 05:36:06.072819 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: exception: Instance 1e32b402-d6f2-4861-a864-005e1a9f808d could not be found. Sep 02 05:36:06.072819 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: action_args: {'id': '1e32b402-d6f2-4861-a864-005e1a9f808d'} Sep 02 05:36:06.073774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:36:06.073774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:36:06.073774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:36:06.073774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:36:06.073774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:36:06.073774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:36:06.073774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:36:06.073774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:36:06.073774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:36:06.073774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:36:06.073774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e32b402-d6f2-4861-a864-005e1a9f808d could not be found. Sep 02 05:36:06.073774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:36:06.073774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:36:06.073774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:36:06.073774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:36:06.073774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:36:06.073774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:36:06.073774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:36:06.073774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:36:06.073774 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:36:06.075335 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:36:06.075335 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:36:06.075335 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:36:06.075335 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:36:06.075335 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:36:06.075335 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:36:06.075335 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:36:06.075335 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e32b402-d6f2-4861-a864-005e1a9f808d could not be found. Sep 02 05:36:06.075335 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:36:06.075335 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:36:06.075335 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:36:06.075335 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:36:06.075335 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:36:06.075335 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:36:06.075335 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:36:06.075335 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:36:06.075335 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e32b402-d6f2-4861-a864-005e1a9f808d could not be found. Sep 02 05:36:06.075335 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:36:06.076809 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-d244fc72-fa25-42fa-9932-faa7063e522f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] Returning 404 to user: Instance 1e32b402-d6f2-4861-a864-005e1a9f808d could not be found. {{(pid=120449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:36:06.076809 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-d244fc72-fa25-42fa-9932-faa7063e522f tempest-AttachVolumeShelveTestJSON-151451576 tempest-AttachVolumeShelveTestJSON-151451576-project] 10.222.0.30 "GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d" status: 404 len: 111 microversion: 2.20 time: 0.033918 Sep 02 05:36:06.084597 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 670/1337] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Sep 2 05:36:06 2022] GET /compute/v2.1/servers/1e32b402-d6f2-4861-a864-005e1a9f808d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 02 05:36:06.790017 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-edf00707-4747-4d53-81ef-a1a626f10494 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:06.790698 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-edf00707-4747-4d53-81ef-a1a626f10494 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b1aa5cbd-af79-4606-8187-fb835b9bb05d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:06.798298 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-edf00707-4747-4d53-81ef-a1a626f10494 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:06.798777 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-edf00707-4747-4d53-81ef-a1a626f10494 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:06.799527 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-edf00707-4747-4d53-81ef-a1a626f10494 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:06.800618 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-edf00707-4747-4d53-81ef-a1a626f10494 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:06.801609 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-edf00707-4747-4d53-81ef-a1a626f10494 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:06.802209 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-edf00707-4747-4d53-81ef-a1a626f10494 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:06.885485 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-edf00707-4747-4d53-81ef-a1a626f10494 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:06.895403 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-edf00707-4747-4d53-81ef-a1a626f10494 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d" status: 200 len: 1192 microversion: 2.1 time: 0.109935 Sep 02 05:36:06.896292 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 668/1338] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:06 2022] GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d => generated 1192 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:07.919451 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-dea6e2c3-4c97-4338-bdf9-4de4b11e8e97 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:07.920082 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-dea6e2c3-4c97-4338-bdf9-4de4b11e8e97 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b1aa5cbd-af79-4606-8187-fb835b9bb05d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:07.926344 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dea6e2c3-4c97-4338-bdf9-4de4b11e8e97 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:07.926822 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dea6e2c3-4c97-4338-bdf9-4de4b11e8e97 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:07.929299 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dea6e2c3-4c97-4338-bdf9-4de4b11e8e97 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:07.930516 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dea6e2c3-4c97-4338-bdf9-4de4b11e8e97 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:07.931216 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dea6e2c3-4c97-4338-bdf9-4de4b11e8e97 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:07.931830 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dea6e2c3-4c97-4338-bdf9-4de4b11e8e97 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:08.291908 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-dea6e2c3-4c97-4338-bdf9-4de4b11e8e97 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:08.313217 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-dea6e2c3-4c97-4338-bdf9-4de4b11e8e97 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d" status: 200 len: 1277 microversion: 2.1 time: 0.397714 Sep 02 05:36:08.326417 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 671/1339] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:07 2022] GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d => generated 1277 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:08.836516 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-dfb7490e-2f0f-4f38-bcf5-9b1ab863591d req-f2a9ab40-0b2a-4a7c-842a-c8fc76a70cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1aa5cbd-af79-4606-8187-fb835b9bb05d", "tag": "9ba8d95a-48ba-4500-9ac5-d13d29cf26c1"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:36:08.855127 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-dfb7490e-2f0f-4f38-bcf5-9b1ab863591d req-f2a9ab40-0b2a-4a7c-842a-c8fc76a70cb0 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:08.855687 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-dfb7490e-2f0f-4f38-bcf5-9b1ab863591d req-f2a9ab40-0b2a-4a7c-842a-c8fc76a70cb0 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:08.856352 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-dfb7490e-2f0f-4f38-bcf5-9b1ab863591d req-f2a9ab40-0b2a-4a7c-842a-c8fc76a70cb0 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:08.877178 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-dfb7490e-2f0f-4f38-bcf5-9b1ab863591d req-f2a9ab40-0b2a-4a7c-842a-c8fc76a70cb0 service nova] Creating event network-changed:9ba8d95a-48ba-4500-9ac5-d13d29cf26c1 for instance b1aa5cbd-af79-4606-8187-fb835b9bb05d on hv-cinder-85391 Sep 02 05:36:08.884457 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-dfb7490e-2f0f-4f38-bcf5-9b1ab863591d req-f2a9ab40-0b2a-4a7c-842a-c8fc76a70cb0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052950 Sep 02 05:36:08.885612 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 669/1340] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:36:09.335134 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-a21dc118-c71f-4280-9e53-461cae816091 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:09.335952 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-a21dc118-c71f-4280-9e53-461cae816091 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b1aa5cbd-af79-4606-8187-fb835b9bb05d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:09.346475 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a21dc118-c71f-4280-9e53-461cae816091 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:09.347603 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a21dc118-c71f-4280-9e53-461cae816091 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:09.349384 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a21dc118-c71f-4280-9e53-461cae816091 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:09.351479 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a21dc118-c71f-4280-9e53-461cae816091 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:09.352054 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a21dc118-c71f-4280-9e53-461cae816091 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:09.353639 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-a21dc118-c71f-4280-9e53-461cae816091 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:09.544556 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-a21dc118-c71f-4280-9e53-461cae816091 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:09.560579 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-a21dc118-c71f-4280-9e53-461cae816091 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d" status: 200 len: 1265 microversion: 2.1 time: 0.229319 Sep 02 05:36:09.562276 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 672/1341] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:09 2022] GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:10.583671 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-42cf2c9f-4783-4468-bf61-1577edaddeb2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:10.585110 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-42cf2c9f-4783-4468-bf61-1577edaddeb2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b1aa5cbd-af79-4606-8187-fb835b9bb05d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:10.591817 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-42cf2c9f-4783-4468-bf61-1577edaddeb2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:10.592216 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-42cf2c9f-4783-4468-bf61-1577edaddeb2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:10.592642 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-42cf2c9f-4783-4468-bf61-1577edaddeb2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:10.593327 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-42cf2c9f-4783-4468-bf61-1577edaddeb2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:10.593770 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-42cf2c9f-4783-4468-bf61-1577edaddeb2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:10.594185 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-42cf2c9f-4783-4468-bf61-1577edaddeb2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:10.756476 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-42cf2c9f-4783-4468-bf61-1577edaddeb2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:10.766588 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-42cf2c9f-4783-4468-bf61-1577edaddeb2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d" status: 200 len: 1265 microversion: 2.1 time: 0.187203 Sep 02 05:36:10.767336 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 670/1342] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:10 2022] GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:11.786806 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-2507aa85-cacd-43b6-8ce1-2a6a08f4cad1 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:11.788013 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-2507aa85-cacd-43b6-8ce1-2a6a08f4cad1 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b1aa5cbd-af79-4606-8187-fb835b9bb05d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:11.794611 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2507aa85-cacd-43b6-8ce1-2a6a08f4cad1 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:11.795093 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2507aa85-cacd-43b6-8ce1-2a6a08f4cad1 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:11.795518 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2507aa85-cacd-43b6-8ce1-2a6a08f4cad1 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:11.796422 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2507aa85-cacd-43b6-8ce1-2a6a08f4cad1 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:11.796874 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2507aa85-cacd-43b6-8ce1-2a6a08f4cad1 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:11.797288 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-2507aa85-cacd-43b6-8ce1-2a6a08f4cad1 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:12.007485 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-2507aa85-cacd-43b6-8ce1-2a6a08f4cad1 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:12.019936 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-2507aa85-cacd-43b6-8ce1-2a6a08f4cad1 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d" status: 200 len: 1265 microversion: 2.1 time: 0.235612 Sep 02 05:36:12.021383 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 673/1343] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:11 2022] GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:13.041264 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f93f11f5-fe31-4cd7-bcf2-609b4b7e0e30 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:13.042032 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f93f11f5-fe31-4cd7-bcf2-609b4b7e0e30 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b1aa5cbd-af79-4606-8187-fb835b9bb05d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:13.048220 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f93f11f5-fe31-4cd7-bcf2-609b4b7e0e30 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:13.048888 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f93f11f5-fe31-4cd7-bcf2-609b4b7e0e30 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:13.049115 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f93f11f5-fe31-4cd7-bcf2-609b4b7e0e30 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:13.049784 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f93f11f5-fe31-4cd7-bcf2-609b4b7e0e30 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:13.050329 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f93f11f5-fe31-4cd7-bcf2-609b4b7e0e30 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:13.050782 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f93f11f5-fe31-4cd7-bcf2-609b4b7e0e30 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:13.192624 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f93f11f5-fe31-4cd7-bcf2-609b4b7e0e30 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:13.200349 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f93f11f5-fe31-4cd7-bcf2-609b4b7e0e30 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d" status: 200 len: 1265 microversion: 2.1 time: 0.162939 Sep 02 05:36:13.201499 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 671/1344] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:13 2022] GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:14.221113 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-05f1f954-540c-4966-8d9e-af7ca02a1da9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:14.221810 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-05f1f954-540c-4966-8d9e-af7ca02a1da9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b1aa5cbd-af79-4606-8187-fb835b9bb05d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:14.228542 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-05f1f954-540c-4966-8d9e-af7ca02a1da9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:14.229024 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-05f1f954-540c-4966-8d9e-af7ca02a1da9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:14.229456 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-05f1f954-540c-4966-8d9e-af7ca02a1da9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:14.230144 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-05f1f954-540c-4966-8d9e-af7ca02a1da9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:14.230580 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-05f1f954-540c-4966-8d9e-af7ca02a1da9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:14.230995 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-05f1f954-540c-4966-8d9e-af7ca02a1da9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:14.368789 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-05f1f954-540c-4966-8d9e-af7ca02a1da9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:14.377017 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-05f1f954-540c-4966-8d9e-af7ca02a1da9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d" status: 200 len: 1265 microversion: 2.1 time: 0.159867 Sep 02 05:36:14.377596 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 674/1345] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:14 2022] GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:15.397562 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-43a79672-598f-4f81-9fa4-7f26295b1526 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:15.398180 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-43a79672-598f-4f81-9fa4-7f26295b1526 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b1aa5cbd-af79-4606-8187-fb835b9bb05d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:15.405123 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-43a79672-598f-4f81-9fa4-7f26295b1526 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:15.405849 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-43a79672-598f-4f81-9fa4-7f26295b1526 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:15.406384 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-43a79672-598f-4f81-9fa4-7f26295b1526 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:15.407220 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-43a79672-598f-4f81-9fa4-7f26295b1526 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:15.407683 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-43a79672-598f-4f81-9fa4-7f26295b1526 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:15.408094 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-43a79672-598f-4f81-9fa4-7f26295b1526 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:15.465748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell0:SELECT=2 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:36:15.488943 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell0:SELECT=6 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:36:15.550908 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-43a79672-598f-4f81-9fa4-7f26295b1526 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:15.558818 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-43a79672-598f-4f81-9fa4-7f26295b1526 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d" status: 200 len: 1265 microversion: 2.1 time: 0.165267 Sep 02 05:36:15.559397 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 672/1346] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:15 2022] GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:16.579279 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-6069c057-b2f1-4bec-b723-2d375dda5413 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:16.579858 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-6069c057-b2f1-4bec-b723-2d375dda5413 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b1aa5cbd-af79-4606-8187-fb835b9bb05d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:16.582307 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell0:SELECT=2 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:36:16.596935 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6069c057-b2f1-4bec-b723-2d375dda5413 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:16.597444 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6069c057-b2f1-4bec-b723-2d375dda5413 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:16.597855 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6069c057-b2f1-4bec-b723-2d375dda5413 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:16.598568 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6069c057-b2f1-4bec-b723-2d375dda5413 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:16.599024 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6069c057-b2f1-4bec-b723-2d375dda5413 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:16.599451 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-6069c057-b2f1-4bec-b723-2d375dda5413 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:16.743750 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-6069c057-b2f1-4bec-b723-2d375dda5413 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:16.751856 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-6069c057-b2f1-4bec-b723-2d375dda5413 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d" status: 200 len: 1265 microversion: 2.1 time: 0.176516 Sep 02 05:36:16.752844 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 675/1347] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:16 2022] GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:17.780187 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-0d8e2afd-a1cf-4ff8-845b-c500557dbf9b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:17.780187 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-0d8e2afd-a1cf-4ff8-845b-c500557dbf9b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b1aa5cbd-af79-4606-8187-fb835b9bb05d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:17.781965 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0d8e2afd-a1cf-4ff8-845b-c500557dbf9b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:17.782457 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0d8e2afd-a1cf-4ff8-845b-c500557dbf9b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:17.782891 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0d8e2afd-a1cf-4ff8-845b-c500557dbf9b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:17.783581 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0d8e2afd-a1cf-4ff8-845b-c500557dbf9b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:17.784025 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0d8e2afd-a1cf-4ff8-845b-c500557dbf9b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:17.784471 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0d8e2afd-a1cf-4ff8-845b-c500557dbf9b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:17.925447 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-0d8e2afd-a1cf-4ff8-845b-c500557dbf9b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:17.933474 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-0d8e2afd-a1cf-4ff8-845b-c500557dbf9b tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d" status: 200 len: 1265 microversion: 2.1 time: 0.163094 Sep 02 05:36:17.934033 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 673/1348] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:17 2022] GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:18.962643 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-349ab571-f9ee-4dda-b71d-117eecaf6ee8 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:18.963970 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-349ab571-f9ee-4dda-b71d-117eecaf6ee8 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b1aa5cbd-af79-4606-8187-fb835b9bb05d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:18.974736 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:36:18.980150 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-349ab571-f9ee-4dda-b71d-117eecaf6ee8 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:18.980941 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-349ab571-f9ee-4dda-b71d-117eecaf6ee8 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:18.981393 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-349ab571-f9ee-4dda-b71d-117eecaf6ee8 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:18.982103 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-349ab571-f9ee-4dda-b71d-117eecaf6ee8 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:18.982585 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-349ab571-f9ee-4dda-b71d-117eecaf6ee8 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:18.983083 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-349ab571-f9ee-4dda-b71d-117eecaf6ee8 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:18.988912 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=79 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:36:19.221332 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-349ab571-f9ee-4dda-b71d-117eecaf6ee8 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:19.229046 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-349ab571-f9ee-4dda-b71d-117eecaf6ee8 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d" status: 200 len: 1265 microversion: 2.1 time: 0.270436 Sep 02 05:36:19.229614 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 676/1349] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:18 2022] GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d => generated 1265 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:20.251204 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-2b0916c7-38a3-46b3-8e78-59fa8f172cf7 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:20.252598 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-2b0916c7-38a3-46b3-8e78-59fa8f172cf7 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b1aa5cbd-af79-4606-8187-fb835b9bb05d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:20.255952 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:36:20.262432 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2b0916c7-38a3-46b3-8e78-59fa8f172cf7 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:20.262966 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2b0916c7-38a3-46b3-8e78-59fa8f172cf7 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:20.263399 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2b0916c7-38a3-46b3-8e78-59fa8f172cf7 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:20.264087 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2b0916c7-38a3-46b3-8e78-59fa8f172cf7 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:20.264584 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2b0916c7-38a3-46b3-8e78-59fa8f172cf7 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:20.265083 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2b0916c7-38a3-46b3-8e78-59fa8f172cf7 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:20.268392 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:36:20.338750 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-c0ddd878-50d8-4bce-b11b-acc48925dd08 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:36:20.341235 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-c0ddd878-50d8-4bce-b11b-acc48925dd08 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:20.347955 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c0ddd878-50d8-4bce-b11b-acc48925dd08 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:20.348560 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c0ddd878-50d8-4bce-b11b-acc48925dd08 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:20.349190 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c0ddd878-50d8-4bce-b11b-acc48925dd08 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:20.349756 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c0ddd878-50d8-4bce-b11b-acc48925dd08 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:20.350327 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c0ddd878-50d8-4bce-b11b-acc48925dd08 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:20.350724 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c0ddd878-50d8-4bce-b11b-acc48925dd08 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:20.413676 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-2b0916c7-38a3-46b3-8e78-59fa8f172cf7 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:20.422578 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-2b0916c7-38a3-46b3-8e78-59fa8f172cf7 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d" status: 200 len: 1265 microversion: 2.1 time: 0.175169 Sep 02 05:36:20.423233 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 674/1350] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:20 2022] GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:20.430980 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-c0ddd878-50d8-4bce-b11b-acc48925dd08 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "POST /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba/action" status: 202 len: 0 microversion: 2.1 time: 0.096147 Sep 02 05:36:20.431903 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 677/1351] 10.222.0.30 () {60 vars in 1278 bytes} [Fri Sep 2 05:36:20 2022] POST /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:36:20.441543 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-3ca2428c-db46-479f-9ca6-793b692700bb tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:20.442156 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-3ca2428c-db46-479f-9ca6-793b692700bb tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:20.448702 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3ca2428c-db46-479f-9ca6-793b692700bb tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:20.449245 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3ca2428c-db46-479f-9ca6-793b692700bb tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:20.449701 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3ca2428c-db46-479f-9ca6-793b692700bb tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:20.450454 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3ca2428c-db46-479f-9ca6-793b692700bb tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:20.450985 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3ca2428c-db46-479f-9ca6-793b692700bb tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:20.451428 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3ca2428c-db46-479f-9ca6-793b692700bb tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:20.607134 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-3ca2428c-db46-479f-9ca6-793b692700bb tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:20.617245 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-3ca2428c-db46-479f-9ca6-793b692700bb tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1750 microversion: 2.1 time: 0.179464 Sep 02 05:36:20.617717 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 675/1352] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:20 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1750 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:21.449041 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-7b775c47-66d8-48e3-ab18-bab17eadb9c0 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:21.450149 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-7b775c47-66d8-48e3-ab18-bab17eadb9c0 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b1aa5cbd-af79-4606-8187-fb835b9bb05d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:21.460948 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7b775c47-66d8-48e3-ab18-bab17eadb9c0 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:21.461433 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7b775c47-66d8-48e3-ab18-bab17eadb9c0 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:21.461870 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7b775c47-66d8-48e3-ab18-bab17eadb9c0 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:21.462562 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7b775c47-66d8-48e3-ab18-bab17eadb9c0 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:21.463012 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7b775c47-66d8-48e3-ab18-bab17eadb9c0 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:21.463437 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7b775c47-66d8-48e3-ab18-bab17eadb9c0 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:21.614670 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-7b775c47-66d8-48e3-ab18-bab17eadb9c0 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:21.623320 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-7b775c47-66d8-48e3-ab18-bab17eadb9c0 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d" status: 200 len: 1265 microversion: 2.1 time: 0.181638 Sep 02 05:36:21.623892 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 678/1353] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:21 2022] GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:21.639204 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-d5e3f4d4-6401-48cd-8217-aa077b16bc93 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:21.639726 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-d5e3f4d4-6401-48cd-8217-aa077b16bc93 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:21.646042 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d5e3f4d4-6401-48cd-8217-aa077b16bc93 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:21.646529 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d5e3f4d4-6401-48cd-8217-aa077b16bc93 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:21.647104 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d5e3f4d4-6401-48cd-8217-aa077b16bc93 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:21.647820 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d5e3f4d4-6401-48cd-8217-aa077b16bc93 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:21.648302 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d5e3f4d4-6401-48cd-8217-aa077b16bc93 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:21.648742 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-d5e3f4d4-6401-48cd-8217-aa077b16bc93 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:21.799135 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-d5e3f4d4-6401-48cd-8217-aa077b16bc93 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:21.807295 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-d5e3f4d4-6401-48cd-8217-aa077b16bc93 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1750 microversion: 2.1 time: 0.172757 Sep 02 05:36:21.807866 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 679/1354] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:21 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1750 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:21.853940 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-fe3591ef-2a82-4d3b-b325-39ad4975e086 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:21.854508 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-fe3591ef-2a82-4d3b-b325-39ad4975e086 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:21.860468 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fe3591ef-2a82-4d3b-b325-39ad4975e086 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:21.860948 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fe3591ef-2a82-4d3b-b325-39ad4975e086 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:21.861732 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fe3591ef-2a82-4d3b-b325-39ad4975e086 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:21.862420 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fe3591ef-2a82-4d3b-b325-39ad4975e086 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:21.862916 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fe3591ef-2a82-4d3b-b325-39ad4975e086 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:21.863335 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-fe3591ef-2a82-4d3b-b325-39ad4975e086 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:21.889492 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-fe3591ef-2a82-4d3b-b325-39ad4975e086 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574/ips" status: 200 len: 144 microversion: 2.1 time: 0.258979 Sep 02 05:36:21.890040 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 676/1355] 10.222.0.30 () {58 vars in 1248 bytes} [Fri Sep 2 05:36:21 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574/ips => generated 144 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:36:22.648586 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-63990727-09a7-49e4-968a-dda1a63c9ca5 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:22.649591 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-63990727-09a7-49e4-968a-dda1a63c9ca5 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b1aa5cbd-af79-4606-8187-fb835b9bb05d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:22.660835 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-63990727-09a7-49e4-968a-dda1a63c9ca5 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:22.661628 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-63990727-09a7-49e4-968a-dda1a63c9ca5 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:22.662389 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-63990727-09a7-49e4-968a-dda1a63c9ca5 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:22.663331 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-63990727-09a7-49e4-968a-dda1a63c9ca5 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:22.663776 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-63990727-09a7-49e4-968a-dda1a63c9ca5 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:22.664272 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-63990727-09a7-49e4-968a-dda1a63c9ca5 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:22.800321 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-63990727-09a7-49e4-968a-dda1a63c9ca5 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:22.808308 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-63990727-09a7-49e4-968a-dda1a63c9ca5 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d" status: 200 len: 1265 microversion: 2.1 time: 0.166377 Sep 02 05:36:22.808853 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 680/1356] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:22 2022] GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:22.829351 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-7d83803d-60c1-45c0-a66f-81022b8b8257 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:22.829965 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-7d83803d-60c1-45c0-a66f-81022b8b8257 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:22.836748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7d83803d-60c1-45c0-a66f-81022b8b8257 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:22.837206 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7d83803d-60c1-45c0-a66f-81022b8b8257 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:22.837657 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7d83803d-60c1-45c0-a66f-81022b8b8257 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:22.838345 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7d83803d-60c1-45c0-a66f-81022b8b8257 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:22.838800 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7d83803d-60c1-45c0-a66f-81022b8b8257 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:22.839223 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7d83803d-60c1-45c0-a66f-81022b8b8257 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:22.999991 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-7d83803d-60c1-45c0-a66f-81022b8b8257 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:23.008422 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-7d83803d-60c1-45c0-a66f-81022b8b8257 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1750 microversion: 2.1 time: 0.182908 Sep 02 05:36:23.008990 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 677/1357] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:22 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1750 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:23.829219 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-11ef7662-2dec-480b-b7e5-7d82483b5183 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:23.830431 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-11ef7662-2dec-480b-b7e5-7d82483b5183 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b1aa5cbd-af79-4606-8187-fb835b9bb05d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:23.837565 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-11ef7662-2dec-480b-b7e5-7d82483b5183 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:23.838065 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-11ef7662-2dec-480b-b7e5-7d82483b5183 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:23.838501 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-11ef7662-2dec-480b-b7e5-7d82483b5183 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:23.839182 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-11ef7662-2dec-480b-b7e5-7d82483b5183 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:23.839632 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-11ef7662-2dec-480b-b7e5-7d82483b5183 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:23.840048 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-11ef7662-2dec-480b-b7e5-7d82483b5183 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:23.969391 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-11ef7662-2dec-480b-b7e5-7d82483b5183 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:23.977053 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-11ef7662-2dec-480b-b7e5-7d82483b5183 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d" status: 200 len: 1265 microversion: 2.1 time: 0.151732 Sep 02 05:36:23.977631 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 681/1358] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:23 2022] GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:24.032865 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-1b4050f9-8def-4325-b7fd-d904d1d9f256 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:24.033834 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-1b4050f9-8def-4325-b7fd-d904d1d9f256 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:24.042122 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1b4050f9-8def-4325-b7fd-d904d1d9f256 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:24.042605 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1b4050f9-8def-4325-b7fd-d904d1d9f256 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:24.043047 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1b4050f9-8def-4325-b7fd-d904d1d9f256 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:24.043731 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1b4050f9-8def-4325-b7fd-d904d1d9f256 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:24.044225 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1b4050f9-8def-4325-b7fd-d904d1d9f256 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:24.044640 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-1b4050f9-8def-4325-b7fd-d904d1d9f256 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:24.194284 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-1b4050f9-8def-4325-b7fd-d904d1d9f256 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:24.202994 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-1b4050f9-8def-4325-b7fd-d904d1d9f256 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1750 microversion: 2.1 time: 0.176505 Sep 02 05:36:24.203540 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 678/1359] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:24 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1750 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:24.596879 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-dec77ef1-ff61-4dcd-a43e-e4dfc962fdbe req-31473d49-0e57-4372-8fa2-9e31e0528623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1aa5cbd-af79-4606-8187-fb835b9bb05d", "name": "network-vif-plugged", "status": "completed", "tag": "9ba8d95a-48ba-4500-9ac5-d13d29cf26c1"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:36:24.606793 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-dec77ef1-ff61-4dcd-a43e-e4dfc962fdbe req-31473d49-0e57-4372-8fa2-9e31e0528623 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:24.607270 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-dec77ef1-ff61-4dcd-a43e-e4dfc962fdbe req-31473d49-0e57-4372-8fa2-9e31e0528623 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:24.607725 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-dec77ef1-ff61-4dcd-a43e-e4dfc962fdbe req-31473d49-0e57-4372-8fa2-9e31e0528623 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:24.619032 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-dec77ef1-ff61-4dcd-a43e-e4dfc962fdbe req-31473d49-0e57-4372-8fa2-9e31e0528623 service nova] Creating event network-vif-plugged:9ba8d95a-48ba-4500-9ac5-d13d29cf26c1 for instance b1aa5cbd-af79-4606-8187-fb835b9bb05d on hv-cinder-85391 Sep 02 05:36:24.624043 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-dec77ef1-ff61-4dcd-a43e-e4dfc962fdbe req-31473d49-0e57-4372-8fa2-9e31e0528623 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090142 Sep 02 05:36:24.624682 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 682/1360] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:36:24.998373 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-05564842-7f9e-49b6-9b10-939628ff98f5 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:24.999012 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-05564842-7f9e-49b6-9b10-939628ff98f5 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b1aa5cbd-af79-4606-8187-fb835b9bb05d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:25.005455 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-05564842-7f9e-49b6-9b10-939628ff98f5 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:25.005947 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-05564842-7f9e-49b6-9b10-939628ff98f5 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:25.006383 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-05564842-7f9e-49b6-9b10-939628ff98f5 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:25.007162 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-05564842-7f9e-49b6-9b10-939628ff98f5 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:25.007653 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-05564842-7f9e-49b6-9b10-939628ff98f5 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:25.008080 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-05564842-7f9e-49b6-9b10-939628ff98f5 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:25.142429 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-05564842-7f9e-49b6-9b10-939628ff98f5 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:25.150830 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-05564842-7f9e-49b6-9b10-939628ff98f5 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d" status: 200 len: 1265 microversion: 2.1 time: 0.156507 Sep 02 05:36:25.151422 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 679/1361] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:24 2022] GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:25.230647 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-b81e9d7c-8430-4087-9ce7-4e12f8b98ab9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:25.231660 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-b81e9d7c-8430-4087-9ce7-4e12f8b98ab9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:25.242567 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b81e9d7c-8430-4087-9ce7-4e12f8b98ab9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:25.243145 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b81e9d7c-8430-4087-9ce7-4e12f8b98ab9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:25.243589 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b81e9d7c-8430-4087-9ce7-4e12f8b98ab9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:25.244390 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b81e9d7c-8430-4087-9ce7-4e12f8b98ab9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:25.244867 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b81e9d7c-8430-4087-9ce7-4e12f8b98ab9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:25.245345 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b81e9d7c-8430-4087-9ce7-4e12f8b98ab9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:25.400513 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-b81e9d7c-8430-4087-9ce7-4e12f8b98ab9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:25.410282 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-b81e9d7c-8430-4087-9ce7-4e12f8b98ab9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1755 microversion: 2.1 time: 0.188054 Sep 02 05:36:25.411060 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 683/1362] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:25 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1755 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:26.172057 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-3782cf85-98a8-4b11-b014-23c3930be43d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:26.173718 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-3782cf85-98a8-4b11-b014-23c3930be43d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b1aa5cbd-af79-4606-8187-fb835b9bb05d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:26.181044 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3782cf85-98a8-4b11-b014-23c3930be43d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:26.181554 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3782cf85-98a8-4b11-b014-23c3930be43d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:26.182035 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3782cf85-98a8-4b11-b014-23c3930be43d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:26.182743 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3782cf85-98a8-4b11-b014-23c3930be43d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:26.183326 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3782cf85-98a8-4b11-b014-23c3930be43d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:26.184013 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3782cf85-98a8-4b11-b014-23c3930be43d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:26.342831 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-3782cf85-98a8-4b11-b014-23c3930be43d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:26.351349 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-3782cf85-98a8-4b11-b014-23c3930be43d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d" status: 200 len: 1265 microversion: 2.1 time: 0.183241 Sep 02 05:36:26.364955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 680/1363] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:26 2022] GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:26.408792 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-198506c0-396c-48f8-80a7-c8c7bbed85e1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23a7291a-ac7b-4052-9084-89dce87b4a52"}} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:36:26.411164 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-198506c0-396c-48f8-80a7-c8c7bbed85e1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:26.417773 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-198506c0-396c-48f8-80a7-c8c7bbed85e1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:26.418378 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-198506c0-396c-48f8-80a7-c8c7bbed85e1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:26.418813 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-198506c0-396c-48f8-80a7-c8c7bbed85e1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:26.419514 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-198506c0-396c-48f8-80a7-c8c7bbed85e1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:26.419964 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-198506c0-396c-48f8-80a7-c8c7bbed85e1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:26.420413 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-198506c0-396c-48f8-80a7-c8c7bbed85e1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:26.431337 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-8fcc5c48-f412-4a00-a7e1-b7ab3b14f13f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:26.432071 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-8fcc5c48-f412-4a00-a7e1-b7ab3b14f13f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:26.438364 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8fcc5c48-f412-4a00-a7e1-b7ab3b14f13f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:26.439077 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8fcc5c48-f412-4a00-a7e1-b7ab3b14f13f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:26.439515 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8fcc5c48-f412-4a00-a7e1-b7ab3b14f13f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:26.440208 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8fcc5c48-f412-4a00-a7e1-b7ab3b14f13f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:26.440824 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8fcc5c48-f412-4a00-a7e1-b7ab3b14f13f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:26.441457 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-8fcc5c48-f412-4a00-a7e1-b7ab3b14f13f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:26.586182 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-8fcc5c48-f412-4a00-a7e1-b7ab3b14f13f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:26.594998 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-8fcc5c48-f412-4a00-a7e1-b7ab3b14f13f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1755 microversion: 2.1 time: 0.167666 Sep 02 05:36:26.596244 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 681/1364] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:26 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:26.734752 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-198506c0-396c-48f8-80a7-c8c7bbed85e1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "POST /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329750 Sep 02 05:36:26.735491 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 684/1365] 10.222.0.30 () {60 vars in 1323 bytes} [Fri Sep 2 05:36:26 2022] POST /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:36:27.381285 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-7c2c5eb5-0586-4021-835e-4df39f1b7440 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:27.382526 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-7c2c5eb5-0586-4021-835e-4df39f1b7440 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b1aa5cbd-af79-4606-8187-fb835b9bb05d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:27.395139 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7c2c5eb5-0586-4021-835e-4df39f1b7440 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:27.395139 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7c2c5eb5-0586-4021-835e-4df39f1b7440 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:27.395878 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7c2c5eb5-0586-4021-835e-4df39f1b7440 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:27.396297 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7c2c5eb5-0586-4021-835e-4df39f1b7440 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:27.397216 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7c2c5eb5-0586-4021-835e-4df39f1b7440 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:27.397216 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7c2c5eb5-0586-4021-835e-4df39f1b7440 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:27.557116 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-7c2c5eb5-0586-4021-835e-4df39f1b7440 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:27.565128 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-7c2c5eb5-0586-4021-835e-4df39f1b7440 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d" status: 200 len: 1451 microversion: 2.1 time: 0.190639 Sep 02 05:36:27.565705 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 682/1366] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:27 2022] GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d => generated 1451 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:27.588761 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-af637cc0-1d00-4618-b0c9-346c4859a0ca tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:27.589792 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-af637cc0-1d00-4618-b0c9-346c4859a0ca tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b1aa5cbd-af79-4606-8187-fb835b9bb05d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:27.598297 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-af637cc0-1d00-4618-b0c9-346c4859a0ca tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:27.598986 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-af637cc0-1d00-4618-b0c9-346c4859a0ca tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:27.600076 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-af637cc0-1d00-4618-b0c9-346c4859a0ca tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:27.600987 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-af637cc0-1d00-4618-b0c9-346c4859a0ca tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:27.601659 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-af637cc0-1d00-4618-b0c9-346c4859a0ca tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:27.602540 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-af637cc0-1d00-4618-b0c9-346c4859a0ca tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:27.617458 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-169a0f87-a28a-48ea-89d1-093d6bac0b04 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:27.618089 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-169a0f87-a28a-48ea-89d1-093d6bac0b04 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:27.624438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-169a0f87-a28a-48ea-89d1-093d6bac0b04 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:27.624919 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-169a0f87-a28a-48ea-89d1-093d6bac0b04 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:27.625347 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-169a0f87-a28a-48ea-89d1-093d6bac0b04 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:27.626072 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-169a0f87-a28a-48ea-89d1-093d6bac0b04 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:27.626723 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-169a0f87-a28a-48ea-89d1-093d6bac0b04 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:27.627297 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-169a0f87-a28a-48ea-89d1-093d6bac0b04 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:27.812159 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-af637cc0-1d00-4618-b0c9-346c4859a0ca tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:27.821280 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-af637cc0-1d00-4618-b0c9-346c4859a0ca tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d" status: 200 len: 1451 microversion: 2.1 time: 0.239088 Sep 02 05:36:27.836746 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 685/1367] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:27 2022] GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d => generated 1451 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:36:27.836872 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-169a0f87-a28a-48ea-89d1-093d6bac0b04 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:27.841062 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-169a0f87-a28a-48ea-89d1-093d6bac0b04 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1755 microversion: 2.1 time: 0.227703 Sep 02 05:36:27.841627 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 683/1368] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:27 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1755 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:36:28.863166 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-8ec337a0-af3c-4ec1-94e2-c4edbb9f493e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:28.863791 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-8ec337a0-af3c-4ec1-94e2-c4edbb9f493e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:28.874746 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8ec337a0-af3c-4ec1-94e2-c4edbb9f493e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:28.875454 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8ec337a0-af3c-4ec1-94e2-c4edbb9f493e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:28.875873 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8ec337a0-af3c-4ec1-94e2-c4edbb9f493e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:28.876999 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8ec337a0-af3c-4ec1-94e2-c4edbb9f493e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:28.877459 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8ec337a0-af3c-4ec1-94e2-c4edbb9f493e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:28.877937 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8ec337a0-af3c-4ec1-94e2-c4edbb9f493e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:29.062489 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-8ec337a0-af3c-4ec1-94e2-c4edbb9f493e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:29.076413 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-8ec337a0-af3c-4ec1-94e2-c4edbb9f493e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1755 microversion: 2.1 time: 0.217374 Sep 02 05:36:29.080190 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 686/1369] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:28 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1755 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:29.652041 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-74d74ce0-7da6-406e-a87a-a7f9680c1eac req-35eff7b5-56cc-4092-96b5-f01354a3cc38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1aa5cbd-af79-4606-8187-fb835b9bb05d", "tag": "9ba8d95a-48ba-4500-9ac5-d13d29cf26c1"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:36:29.662187 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-74d74ce0-7da6-406e-a87a-a7f9680c1eac req-35eff7b5-56cc-4092-96b5-f01354a3cc38 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:29.662673 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-74d74ce0-7da6-406e-a87a-a7f9680c1eac req-35eff7b5-56cc-4092-96b5-f01354a3cc38 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:29.663103 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-74d74ce0-7da6-406e-a87a-a7f9680c1eac req-35eff7b5-56cc-4092-96b5-f01354a3cc38 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:29.674549 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-74d74ce0-7da6-406e-a87a-a7f9680c1eac req-35eff7b5-56cc-4092-96b5-f01354a3cc38 service nova] Creating event network-changed:9ba8d95a-48ba-4500-9ac5-d13d29cf26c1 for instance b1aa5cbd-af79-4606-8187-fb835b9bb05d on hv-cinder-85391 Sep 02 05:36:29.679749 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-74d74ce0-7da6-406e-a87a-a7f9680c1eac req-35eff7b5-56cc-4092-96b5-f01354a3cc38 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031955 Sep 02 05:36:29.680514 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 684/1370] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 05:36:30.099687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-94f38b04-0409-404b-aa82-db7a25c67680 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:30.100471 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-94f38b04-0409-404b-aa82-db7a25c67680 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:30.122816 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-94f38b04-0409-404b-aa82-db7a25c67680 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:30.123594 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-94f38b04-0409-404b-aa82-db7a25c67680 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:30.125553 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-94f38b04-0409-404b-aa82-db7a25c67680 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:30.127512 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-94f38b04-0409-404b-aa82-db7a25c67680 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:30.130143 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-94f38b04-0409-404b-aa82-db7a25c67680 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:30.132669 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-94f38b04-0409-404b-aa82-db7a25c67680 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:30.375484 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-94f38b04-0409-404b-aa82-db7a25c67680 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:30.389828 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-94f38b04-0409-404b-aa82-db7a25c67680 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1755 microversion: 2.1 time: 0.294871 Sep 02 05:36:30.391953 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 687/1371] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:30 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1755 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:31.413472 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-0bb2b23f-47ed-4a71-9799-9cab0f7b6af4 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:31.414149 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-0bb2b23f-47ed-4a71-9799-9cab0f7b6af4 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:31.421468 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0bb2b23f-47ed-4a71-9799-9cab0f7b6af4 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:31.421940 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0bb2b23f-47ed-4a71-9799-9cab0f7b6af4 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:31.422392 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0bb2b23f-47ed-4a71-9799-9cab0f7b6af4 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:31.423075 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0bb2b23f-47ed-4a71-9799-9cab0f7b6af4 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:31.423524 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0bb2b23f-47ed-4a71-9799-9cab0f7b6af4 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:31.423938 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-0bb2b23f-47ed-4a71-9799-9cab0f7b6af4 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:31.576303 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-0bb2b23f-47ed-4a71-9799-9cab0f7b6af4 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:31.584977 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-0bb2b23f-47ed-4a71-9799-9cab0f7b6af4 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1755 microversion: 2.1 time: 0.176317 Sep 02 05:36:31.585596 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 685/1372] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:31 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:32.609289 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-b5217cdd-1c84-4d7c-81fc-eae9a7b5fbbc tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:32.610424 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-b5217cdd-1c84-4d7c-81fc-eae9a7b5fbbc tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:32.617752 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b5217cdd-1c84-4d7c-81fc-eae9a7b5fbbc tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:32.618232 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b5217cdd-1c84-4d7c-81fc-eae9a7b5fbbc tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:32.618779 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b5217cdd-1c84-4d7c-81fc-eae9a7b5fbbc tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:32.619495 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b5217cdd-1c84-4d7c-81fc-eae9a7b5fbbc tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:32.619978 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b5217cdd-1c84-4d7c-81fc-eae9a7b5fbbc tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:32.620426 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b5217cdd-1c84-4d7c-81fc-eae9a7b5fbbc tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:32.778961 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-b5217cdd-1c84-4d7c-81fc-eae9a7b5fbbc tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:32.794881 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-b5217cdd-1c84-4d7c-81fc-eae9a7b5fbbc tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1755 microversion: 2.1 time: 0.190040 Sep 02 05:36:32.795614 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 688/1373] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:32 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:33.819027 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-c04d836b-4e99-4ef3-a722-4a58c6e0b32e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:33.819627 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-c04d836b-4e99-4ef3-a722-4a58c6e0b32e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:33.826468 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c04d836b-4e99-4ef3-a722-4a58c6e0b32e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:33.826943 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c04d836b-4e99-4ef3-a722-4a58c6e0b32e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:33.827370 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c04d836b-4e99-4ef3-a722-4a58c6e0b32e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:33.828564 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c04d836b-4e99-4ef3-a722-4a58c6e0b32e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:33.828564 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c04d836b-4e99-4ef3-a722-4a58c6e0b32e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:33.828564 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-c04d836b-4e99-4ef3-a722-4a58c6e0b32e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:33.984082 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-c04d836b-4e99-4ef3-a722-4a58c6e0b32e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:33.995186 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-c04d836b-4e99-4ef3-a722-4a58c6e0b32e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1755 microversion: 2.1 time: 0.180091 Sep 02 05:36:33.996560 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 686/1374] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:33 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:35.019309 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-b3d106e5-10fb-47a8-a32d-f9a30c2679de tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:35.019683 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-b3d106e5-10fb-47a8-a32d-f9a30c2679de tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:35.037601 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b3d106e5-10fb-47a8-a32d-f9a30c2679de tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:35.038379 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b3d106e5-10fb-47a8-a32d-f9a30c2679de tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:35.038987 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b3d106e5-10fb-47a8-a32d-f9a30c2679de tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:35.040075 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b3d106e5-10fb-47a8-a32d-f9a30c2679de tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:35.040712 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b3d106e5-10fb-47a8-a32d-f9a30c2679de tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:35.041290 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b3d106e5-10fb-47a8-a32d-f9a30c2679de tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:35.208286 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-b3d106e5-10fb-47a8-a32d-f9a30c2679de tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:35.219956 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-b3d106e5-10fb-47a8-a32d-f9a30c2679de tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1755 microversion: 2.1 time: 0.204872 Sep 02 05:36:35.220749 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 689/1375] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:35 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1755 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:35.444154 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-84c5af0c-c76c-4e86-8c95-982beb4f2349 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:35.446380 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-84c5af0c-c76c-4e86-8c95-982beb4f2349 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:35.453233 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-84c5af0c-c76c-4e86-8c95-982beb4f2349 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:35.453710 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-84c5af0c-c76c-4e86-8c95-982beb4f2349 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:35.454137 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-84c5af0c-c76c-4e86-8c95-982beb4f2349 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:35.454823 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-84c5af0c-c76c-4e86-8c95-982beb4f2349 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:35.455272 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-84c5af0c-c76c-4e86-8c95-982beb4f2349 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:35.455682 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-84c5af0c-c76c-4e86-8c95-982beb4f2349 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:35.486524 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-84c5af0c-c76c-4e86-8c95-982beb4f2349 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046460 Sep 02 05:36:35.487101 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 687/1376] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Sep 2 05:36:35 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:36:35.502411 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-460672a2-362a-4e5a-a3f4-b4876be6a306 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:35.502889 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-460672a2-362a-4e5a-a3f4-b4876be6a306 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:35.510384 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-460672a2-362a-4e5a-a3f4-b4876be6a306 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:35.510868 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-460672a2-362a-4e5a-a3f4-b4876be6a306 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:35.511301 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-460672a2-362a-4e5a-a3f4-b4876be6a306 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:35.512037 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-460672a2-362a-4e5a-a3f4-b4876be6a306 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:35.512557 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-460672a2-362a-4e5a-a3f4-b4876be6a306 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:35.512976 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-460672a2-362a-4e5a-a3f4-b4876be6a306 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:35.547097 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-460672a2-362a-4e5a-a3f4-b4876be6a306 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574/os-volume_attachments/23a7291a-ac7b-4052-9084-89dce87b4a52" status: 200 len: 194 microversion: 2.1 time: 0.052480 Sep 02 05:36:35.548099 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 690/1377] 10.222.0.30 () {58 vars in 1413 bytes} [Fri Sep 2 05:36:35 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574/os-volume_attachments/23a7291a-ac7b-4052-9084-89dce87b4a52 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:36:36.245745 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-92ee223b-38f8-4911-997d-13222bf14af5 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:36.246371 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-92ee223b-38f8-4911-997d-13222bf14af5 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:36.252912 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-92ee223b-38f8-4911-997d-13222bf14af5 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:36.253402 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-92ee223b-38f8-4911-997d-13222bf14af5 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:36.253862 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-92ee223b-38f8-4911-997d-13222bf14af5 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:36.254550 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-92ee223b-38f8-4911-997d-13222bf14af5 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:36.254997 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-92ee223b-38f8-4911-997d-13222bf14af5 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:36.255414 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-92ee223b-38f8-4911-997d-13222bf14af5 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:36.416750 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-92ee223b-38f8-4911-997d-13222bf14af5 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:36.424905 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-92ee223b-38f8-4911-997d-13222bf14af5 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1755 microversion: 2.1 time: 0.183034 Sep 02 05:36:36.425469 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 688/1378] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:36 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:37.449667 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-9bf646be-aca4-4076-8410-618d0ac20a46 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:37.450435 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-9bf646be-aca4-4076-8410-618d0ac20a46 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:37.458664 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9bf646be-aca4-4076-8410-618d0ac20a46 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:37.459141 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9bf646be-aca4-4076-8410-618d0ac20a46 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:37.459539 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9bf646be-aca4-4076-8410-618d0ac20a46 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:37.460279 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9bf646be-aca4-4076-8410-618d0ac20a46 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:37.460725 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9bf646be-aca4-4076-8410-618d0ac20a46 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:37.461136 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-9bf646be-aca4-4076-8410-618d0ac20a46 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:37.463739 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:36:37.637501 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-9bf646be-aca4-4076-8410-618d0ac20a46 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:37.646428 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-9bf646be-aca4-4076-8410-618d0ac20a46 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1755 microversion: 2.1 time: 0.203479 Sep 02 05:36:37.647333 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 691/1379] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:37 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1755 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:37.966796 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-b7562c71-68b2-4e70-97c6-e3115297abe2 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18b011f4-7dea-4144-8fe5-78a7c1cdf688"}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:36:37.969319 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-b7562c71-68b2-4e70-97c6-e3115297abe2 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:37.976189 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b7562c71-68b2-4e70-97c6-e3115297abe2 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:37.977007 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b7562c71-68b2-4e70-97c6-e3115297abe2 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:37.977434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b7562c71-68b2-4e70-97c6-e3115297abe2 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:37.978145 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b7562c71-68b2-4e70-97c6-e3115297abe2 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:37.978593 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b7562c71-68b2-4e70-97c6-e3115297abe2 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:37.979014 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b7562c71-68b2-4e70-97c6-e3115297abe2 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:38.358801 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-b7562c71-68b2-4e70-97c6-e3115297abe2 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "POST /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.396276 Sep 02 05:36:38.359434 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 689/1380] 10.222.0.30 () {60 vars in 1323 bytes} [Fri Sep 2 05:36:37 2022] POST /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574/os-volume_attachments => generated 194 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:36:38.667547 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-792ecb3b-ed94-4f62-bbb9-bcde95ba3ce2 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:38.668442 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-792ecb3b-ed94-4f62-bbb9-bcde95ba3ce2 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:38.674639 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-792ecb3b-ed94-4f62-bbb9-bcde95ba3ce2 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:38.675114 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-792ecb3b-ed94-4f62-bbb9-bcde95ba3ce2 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:38.675545 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-792ecb3b-ed94-4f62-bbb9-bcde95ba3ce2 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:38.676262 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-792ecb3b-ed94-4f62-bbb9-bcde95ba3ce2 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:38.676713 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-792ecb3b-ed94-4f62-bbb9-bcde95ba3ce2 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:38.677133 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-792ecb3b-ed94-4f62-bbb9-bcde95ba3ce2 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:38.868327 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-792ecb3b-ed94-4f62-bbb9-bcde95ba3ce2 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:38.877430 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-792ecb3b-ed94-4f62-bbb9-bcde95ba3ce2 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1755 microversion: 2.1 time: 0.213688 Sep 02 05:36:38.878020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 692/1381] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:38 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1755 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:39.900091 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-4f002df6-2382-4fcc-b3f1-8b7675815d5e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:39.900727 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-4f002df6-2382-4fcc-b3f1-8b7675815d5e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:39.907163 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4f002df6-2382-4fcc-b3f1-8b7675815d5e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:39.907771 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4f002df6-2382-4fcc-b3f1-8b7675815d5e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:39.908248 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4f002df6-2382-4fcc-b3f1-8b7675815d5e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:39.909009 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4f002df6-2382-4fcc-b3f1-8b7675815d5e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:39.909376 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4f002df6-2382-4fcc-b3f1-8b7675815d5e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:39.909803 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-4f002df6-2382-4fcc-b3f1-8b7675815d5e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:39.925504 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:36:40.076353 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-4f002df6-2382-4fcc-b3f1-8b7675815d5e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:40.084945 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-4f002df6-2382-4fcc-b3f1-8b7675815d5e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1755 microversion: 2.1 time: 0.189734 Sep 02 05:36:40.085576 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 690/1382] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:39 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1755 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:41.109700 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-02774c03-b171-4bd1-ae8e-a298f5072d0f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:41.110932 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-02774c03-b171-4bd1-ae8e-a298f5072d0f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:41.118986 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-02774c03-b171-4bd1-ae8e-a298f5072d0f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:41.119490 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-02774c03-b171-4bd1-ae8e-a298f5072d0f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:41.120058 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-02774c03-b171-4bd1-ae8e-a298f5072d0f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:41.120742 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-02774c03-b171-4bd1-ae8e-a298f5072d0f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:41.121231 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-02774c03-b171-4bd1-ae8e-a298f5072d0f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:41.121674 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-02774c03-b171-4bd1-ae8e-a298f5072d0f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:41.267075 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-02774c03-b171-4bd1-ae8e-a298f5072d0f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:41.276951 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-02774c03-b171-4bd1-ae8e-a298f5072d0f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1758 microversion: 2.1 time: 0.173687 Sep 02 05:36:41.277874 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 693/1383] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:41 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:46.988502 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-de101c90-6ef9-4d7d-9327-786f74d276f1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:46.990923 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-de101c90-6ef9-4d7d-9327-786f74d276f1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:46.997892 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-de101c90-6ef9-4d7d-9327-786f74d276f1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:46.998460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-de101c90-6ef9-4d7d-9327-786f74d276f1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:46.998895 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-de101c90-6ef9-4d7d-9327-786f74d276f1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:46.999602 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-de101c90-6ef9-4d7d-9327-786f74d276f1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:47.000046 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-de101c90-6ef9-4d7d-9327-786f74d276f1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:47.000495 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-de101c90-6ef9-4d7d-9327-786f74d276f1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:47.030091 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-de101c90-6ef9-4d7d-9327-786f74d276f1 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045887 Sep 02 05:36:47.030660 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 691/1384] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Sep 2 05:36:46 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:36:47.172326 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-24dc40f5-8cb5-48de-bb82-77f3a62fd554 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:47.172914 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-24dc40f5-8cb5-48de-bb82-77f3a62fd554 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:47.180788 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-24dc40f5-8cb5-48de-bb82-77f3a62fd554 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:47.181272 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-24dc40f5-8cb5-48de-bb82-77f3a62fd554 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:47.181719 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-24dc40f5-8cb5-48de-bb82-77f3a62fd554 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:47.182389 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-24dc40f5-8cb5-48de-bb82-77f3a62fd554 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:47.182832 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-24dc40f5-8cb5-48de-bb82-77f3a62fd554 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:47.183247 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-24dc40f5-8cb5-48de-bb82-77f3a62fd554 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:47.214749 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-24dc40f5-8cb5-48de-bb82-77f3a62fd554 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574/os-volume_attachments/23a7291a-ac7b-4052-9084-89dce87b4a52" status: 200 len: 194 microversion: 2.1 time: 0.047122 Sep 02 05:36:47.215354 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 694/1385] 10.222.0.30 () {58 vars in 1413 bytes} [Fri Sep 2 05:36:47 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574/os-volume_attachments/23a7291a-ac7b-4052-9084-89dce87b4a52 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:36:47.226761 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d4eb7cff-59c4-4647-a64f-f2ba58cf3386 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:47.227294 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-d4eb7cff-59c4-4647-a64f-f2ba58cf3386 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:47.233959 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d4eb7cff-59c4-4647-a64f-f2ba58cf3386 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:47.234646 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d4eb7cff-59c4-4647-a64f-f2ba58cf3386 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:47.235074 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d4eb7cff-59c4-4647-a64f-f2ba58cf3386 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:47.235770 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d4eb7cff-59c4-4647-a64f-f2ba58cf3386 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:47.236623 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d4eb7cff-59c4-4647-a64f-f2ba58cf3386 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:47.237045 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d4eb7cff-59c4-4647-a64f-f2ba58cf3386 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:47.329959 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.objects.instance [None req-d4eb7cff-59c4-4647-a64f-f2ba58cf3386 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lazy-loading 'services' on Instance uuid d19306c3-935d-4876-9adb-651da56d0574 {{(pid=120448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:36:47.409648 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-d4eb7cff-59c4-4647-a64f-f2ba58cf3386 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574/os-volume_attachments/23a7291a-ac7b-4052-9084-89dce87b4a52" status: 202 len: 0 microversion: 2.1 time: 0.187186 Sep 02 05:36:47.410320 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 692/1386] 10.222.0.30 () {58 vars in 1416 bytes} [Fri Sep 2 05:36:47 2022] DELETE /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574/os-volume_attachments/23a7291a-ac7b-4052-9084-89dce87b4a52 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:36:49.592235 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-b78367f3-07ac-458a-9238-744ad70938b7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:49.592776 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-b78367f3-07ac-458a-9238-744ad70938b7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:49.595190 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_api:SELECT=38 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:36:49.600616 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b78367f3-07ac-458a-9238-744ad70938b7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:49.601121 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b78367f3-07ac-458a-9238-744ad70938b7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:49.601553 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b78367f3-07ac-458a-9238-744ad70938b7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:49.602240 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b78367f3-07ac-458a-9238-744ad70938b7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:49.602731 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b78367f3-07ac-458a-9238-744ad70938b7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:49.603152 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b78367f3-07ac-458a-9238-744ad70938b7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:49.634455 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-b78367f3-07ac-458a-9238-744ad70938b7 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574/os-volume_attachments/18b011f4-7dea-4144-8fe5-78a7c1cdf688" status: 200 len: 194 microversion: 2.1 time: 0.046295 Sep 02 05:36:49.635032 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 695/1387] 10.222.0.30 () {58 vars in 1413 bytes} [Fri Sep 2 05:36:49 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574/os-volume_attachments/18b011f4-7dea-4144-8fe5-78a7c1cdf688 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:36:49.648855 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-3b562e5c-11e1-4d1d-9890-aacafc523d9d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:49.649563 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-3b562e5c-11e1-4d1d-9890-aacafc523d9d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:49.656211 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3b562e5c-11e1-4d1d-9890-aacafc523d9d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:49.656700 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3b562e5c-11e1-4d1d-9890-aacafc523d9d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:49.657120 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3b562e5c-11e1-4d1d-9890-aacafc523d9d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:49.657802 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3b562e5c-11e1-4d1d-9890-aacafc523d9d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:49.658248 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3b562e5c-11e1-4d1d-9890-aacafc523d9d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:49.658700 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-3b562e5c-11e1-4d1d-9890-aacafc523d9d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:49.757293 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.objects.instance [None req-3b562e5c-11e1-4d1d-9890-aacafc523d9d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lazy-loading 'services' on Instance uuid d19306c3-935d-4876-9adb-651da56d0574 {{(pid=120448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:36:49.848359 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-3b562e5c-11e1-4d1d-9890-aacafc523d9d tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574/os-volume_attachments/18b011f4-7dea-4144-8fe5-78a7c1cdf688" status: 202 len: 0 microversion: 2.1 time: 0.204268 Sep 02 05:36:49.848978 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 693/1388] 10.222.0.30 () {58 vars in 1416 bytes} [Fri Sep 2 05:36:49 2022] DELETE /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574/os-volume_attachments/18b011f4-7dea-4144-8fe5-78a7c1cdf688 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:36:52.089396 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-addf3f7d-8e86-4467-bf3b-ee1ca069212b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:52.091654 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-addf3f7d-8e86-4467-bf3b-ee1ca069212b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:52.099410 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-addf3f7d-8e86-4467-bf3b-ee1ca069212b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:52.099898 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-addf3f7d-8e86-4467-bf3b-ee1ca069212b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:52.100353 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-addf3f7d-8e86-4467-bf3b-ee1ca069212b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:52.101038 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-addf3f7d-8e86-4467-bf3b-ee1ca069212b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:52.101488 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-addf3f7d-8e86-4467-bf3b-ee1ca069212b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:52.101905 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-addf3f7d-8e86-4467-bf3b-ee1ca069212b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:52.131190 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-addf3f7d-8e86-4467-bf3b-ee1ca069212b tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045728 Sep 02 05:36:52.131758 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 696/1389] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Sep 2 05:36:52 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 05:36:52.243461 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-6502251b-b07a-4865-a882-6ace095d97fc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:52.246065 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-6502251b-b07a-4865-a882-6ace095d97fc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:52.248033 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=40 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:36:52.253529 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6502251b-b07a-4865-a882-6ace095d97fc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:52.254013 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6502251b-b07a-4865-a882-6ace095d97fc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:52.254440 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6502251b-b07a-4865-a882-6ace095d97fc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:52.255325 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6502251b-b07a-4865-a882-6ace095d97fc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:52.255780 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6502251b-b07a-4865-a882-6ace095d97fc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:52.256231 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6502251b-b07a-4865-a882-6ace095d97fc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:52.285640 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-6502251b-b07a-4865-a882-6ace095d97fc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046945 Sep 02 05:36:52.286206 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 694/1390] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Sep 2 05:36:52 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 05:36:52.347080 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-41976e02-973f-47ae-8596-a340a6872b97 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:52.347604 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-41976e02-973f-47ae-8596-a340a6872b97 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:52.353587 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-41976e02-973f-47ae-8596-a340a6872b97 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:52.354100 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-41976e02-973f-47ae-8596-a340a6872b97 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:52.354523 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-41976e02-973f-47ae-8596-a340a6872b97 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:52.355183 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-41976e02-973f-47ae-8596-a340a6872b97 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:52.355659 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-41976e02-973f-47ae-8596-a340a6872b97 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:52.356045 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-41976e02-973f-47ae-8596-a340a6872b97 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:52.382337 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-41976e02-973f-47ae-8596-a340a6872b97 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Going to try to terminate instance {{(pid=120449) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 05:36:52.463387 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-41976e02-973f-47ae-8596-a340a6872b97 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 204 len: 0 microversion: 2.1 time: 0.119694 Sep 02 05:36:52.464772 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 697/1391] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Sep 2 05:36:52 2022] DELETE /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 05:36:52.475560 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-b83e0967-b90b-4c12-85a9-0869a330b96c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:52.476301 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-b83e0967-b90b-4c12-85a9-0869a330b96c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:52.483819 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b83e0967-b90b-4c12-85a9-0869a330b96c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:52.483944 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b83e0967-b90b-4c12-85a9-0869a330b96c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:52.484647 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b83e0967-b90b-4c12-85a9-0869a330b96c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:52.486040 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b83e0967-b90b-4c12-85a9-0869a330b96c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:52.486990 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b83e0967-b90b-4c12-85a9-0869a330b96c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:52.487475 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b83e0967-b90b-4c12-85a9-0869a330b96c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:52.652631 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-b83e0967-b90b-4c12-85a9-0869a330b96c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:52.661417 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-b83e0967-b90b-4c12-85a9-0869a330b96c tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1672 microversion: 2.1 time: 0.192107 Sep 02 05:36:52.662180 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 695/1392] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:52 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1672 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:53.683273 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-1a9ded7f-61a6-4db8-ae4c-7869b80f8804 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:53.684642 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-1a9ded7f-61a6-4db8-ae4c-7869b80f8804 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:53.690928 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1a9ded7f-61a6-4db8-ae4c-7869b80f8804 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:53.691453 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1a9ded7f-61a6-4db8-ae4c-7869b80f8804 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:53.691821 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1a9ded7f-61a6-4db8-ae4c-7869b80f8804 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:53.692540 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1a9ded7f-61a6-4db8-ae4c-7869b80f8804 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:53.692973 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1a9ded7f-61a6-4db8-ae4c-7869b80f8804 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:53.693407 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1a9ded7f-61a6-4db8-ae4c-7869b80f8804 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:53.827696 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1a9ded7f-61a6-4db8-ae4c-7869b80f8804 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:53.836444 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-1a9ded7f-61a6-4db8-ae4c-7869b80f8804 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1672 microversion: 2.1 time: 0.157483 Sep 02 05:36:53.837107 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 698/1393] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:53 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:54.858239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-97cbe00f-41cd-4949-9aa2-b78cf5373b5e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:54.858813 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-97cbe00f-41cd-4949-9aa2-b78cf5373b5e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:54.866119 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-97cbe00f-41cd-4949-9aa2-b78cf5373b5e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:54.866600 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-97cbe00f-41cd-4949-9aa2-b78cf5373b5e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:54.867035 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-97cbe00f-41cd-4949-9aa2-b78cf5373b5e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:54.867729 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-97cbe00f-41cd-4949-9aa2-b78cf5373b5e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:54.868199 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-97cbe00f-41cd-4949-9aa2-b78cf5373b5e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:54.868631 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-97cbe00f-41cd-4949-9aa2-b78cf5373b5e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:55.005741 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-97cbe00f-41cd-4949-9aa2-b78cf5373b5e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:55.014570 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-97cbe00f-41cd-4949-9aa2-b78cf5373b5e tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1672 microversion: 2.1 time: 0.160225 Sep 02 05:36:55.015122 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 696/1394] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:54 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:56.036463 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-b297e497-684a-4041-abde-61a807dc9aae tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:56.037136 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-b297e497-684a-4041-abde-61a807dc9aae tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:56.043949 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b297e497-684a-4041-abde-61a807dc9aae tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:56.044473 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b297e497-684a-4041-abde-61a807dc9aae tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:56.044890 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b297e497-684a-4041-abde-61a807dc9aae tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:56.045619 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b297e497-684a-4041-abde-61a807dc9aae tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:56.046082 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b297e497-684a-4041-abde-61a807dc9aae tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:56.046483 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-b297e497-684a-4041-abde-61a807dc9aae tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:56.186164 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-b297e497-684a-4041-abde-61a807dc9aae tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:56.195255 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-b297e497-684a-4041-abde-61a807dc9aae tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1672 microversion: 2.1 time: 0.162715 Sep 02 05:36:56.195971 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 699/1395] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:56 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:56.717535 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-f1558938-b64a-4bf0-90a2-bbd3e31cfd92 req-657dc74e-a283-48c7-8c39-ad7962a93a11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d19306c3-935d-4876-9adb-651da56d0574", "name": "network-vif-deleted", "tag": "e83b7424-9d82-42cb-813a-c872cb5208ac"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:36:56.731799 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-f1558938-b64a-4bf0-90a2-bbd3e31cfd92 req-657dc74e-a283-48c7-8c39-ad7962a93a11 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:56.732308 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-f1558938-b64a-4bf0-90a2-bbd3e31cfd92 req-657dc74e-a283-48c7-8c39-ad7962a93a11 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:56.732738 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-f1558938-b64a-4bf0-90a2-bbd3e31cfd92 req-657dc74e-a283-48c7-8c39-ad7962a93a11 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:56.745684 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-f1558938-b64a-4bf0-90a2-bbd3e31cfd92 req-657dc74e-a283-48c7-8c39-ad7962a93a11 service nova] Creating event network-vif-deleted:e83b7424-9d82-42cb-813a-c872cb5208ac for instance d19306c3-935d-4876-9adb-651da56d0574 on hv-cinder-85391 Sep 02 05:36:56.752439 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-f1558938-b64a-4bf0-90a2-bbd3e31cfd92 req-657dc74e-a283-48c7-8c39-ad7962a93a11 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040929 Sep 02 05:36:56.753372 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 697/1396] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:36:57.219866 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-30b7062f-1462-4ea5-a81f-f349573a5e06 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:57.220522 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-30b7062f-1462-4ea5-a81f-f349573a5e06 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:57.227364 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-30b7062f-1462-4ea5-a81f-f349573a5e06 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:57.227874 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-30b7062f-1462-4ea5-a81f-f349573a5e06 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:57.228337 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-30b7062f-1462-4ea5-a81f-f349573a5e06 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:57.229047 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-30b7062f-1462-4ea5-a81f-f349573a5e06 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:57.229475 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-30b7062f-1462-4ea5-a81f-f349573a5e06 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:57.230245 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-30b7062f-1462-4ea5-a81f-f349573a5e06 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:57.265213 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-30b7062f-1462-4ea5-a81f-f349573a5e06 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:57.265700 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-30b7062f-1462-4ea5-a81f-f349573a5e06 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:57.266138 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-30b7062f-1462-4ea5-a81f-f349573a5e06 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:57.266654 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.objects.instance [None req-30b7062f-1462-4ea5-a81f-f349573a5e06 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lazy-loading 'fault' on Instance uuid d19306c3-935d-4876-9adb-651da56d0574 {{(pid=120449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:36:57.309319 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-30b7062f-1462-4ea5-a81f-f349573a5e06 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdba1dc4a5e9482cb4eb94d914c108bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b420db5aef422b9ea85708c2d8e108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:36:57.317761 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-30b7062f-1462-4ea5-a81f-f349573a5e06 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 200 len: 1327 microversion: 2.1 time: 0.103804 Sep 02 05:36:57.318695 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 700/1397] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:57 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 1327 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:36:58.340274 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-167e08a4-4df9-413e-ac6e-a8d3766f2517 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:58.340971 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-167e08a4-4df9-413e-ac6e-a8d3766f2517 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:36:58.347365 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-167e08a4-4df9-413e-ac6e-a8d3766f2517 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:58.347837 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-167e08a4-4df9-413e-ac6e-a8d3766f2517 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:58.348333 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-167e08a4-4df9-413e-ac6e-a8d3766f2517 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:58.349017 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-167e08a4-4df9-413e-ac6e-a8d3766f2517 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:36:58.349463 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-167e08a4-4df9-413e-ac6e-a8d3766f2517 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:36:58.349873 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-167e08a4-4df9-413e-ac6e-a8d3766f2517 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:36:58.363955 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.wsgi [None req-167e08a4-4df9-413e-ac6e-a8d3766f2517 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] HTTP exception thrown: Instance d19306c3-935d-4876-9adb-651da56d0574 could not be found. Sep 02 05:36:58.365615 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-167e08a4-4df9-413e-ac6e-a8d3766f2517 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Request method failure captured: Sep 02 05:36:58.365615 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: request: GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 HTTP/1.1 Sep 02 05:36:58.365615 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept: application/json Sep 02 05:36:58.365615 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept-Encoding: identity Sep 02 05:36:58.365615 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Connection: close Sep 02 05:36:58.365615 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Length: 0 Sep 02 05:36:58.365615 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Type: application/json Sep 02 05:36:58.365615 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Host: 10.222.0.30 Sep 02 05:36:58.365615 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Openstack-System-Scope: None Sep 02 05:36:58.365615 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: User-Agent: python-urllib3/1.26.12 Sep 02 05:36:58.365615 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Auth-Token: gAAAAABjEZO5ixJTZLz6GGk-3Cr-UsnGjf2fgRdovThyegYcUwGTIuBtMMuCdgeKbQJIaRTwe1ps114Qxla8kszN3d3AeK9Ge4SGm55AldIpFwEAQsLBxnADifS_DFBEUjAuZ9KNqgx7fINlHDitlJoBTKxbiT90OE1W6K8UclbDQ4rqPrHqm2A Sep 02 05:36:58.365615 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Id: None Sep 02 05:36:58.365615 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Name: None Sep 02 05:36:58.365615 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Identity-Status: Confirmed Sep 02 05:36:58.365615 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Is-Admin-Project: True Sep 02 05:36:58.365615 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Id: default Sep 02 05:36:58.365615 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Name: Default Sep 02 05:36:58.365615 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Id: 88b420db5aef422b9ea85708c2d8e108 Sep 02 05:36:58.365615 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Name: tempest-AttachVolumeTestJSON-706896050 Sep 02 05:36:58.365615 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Role: member,reader Sep 02 05:36:58.365615 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Roles: member,reader Sep 02 05:36:58.367418 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_88b420db5aef422b9ea85708c2d8e108"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/88b420db5aef422b9ea85708c2d8e108"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/88b420db5aef422b9ea85708c2d8e108"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/88b420db5aef422b9ea85708c2d8e108"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:36:58.367418 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant: tempest-AttachVolumeTestJSON-706896050 Sep 02 05:36:58.367418 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Id: 88b420db5aef422b9ea85708c2d8e108 Sep 02 05:36:58.367418 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Name: tempest-AttachVolumeTestJSON-706896050 Sep 02 05:36:58.367418 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User: tempest-AttachVolumeTestJSON-706896050-project Sep 02 05:36:58.367418 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Id: default Sep 02 05:36:58.367418 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Name: Default Sep 02 05:36:58.367418 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Id: bdba1dc4a5e9482cb4eb94d914c108bf Sep 02 05:36:58.367418 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Name: tempest-AttachVolumeTestJSON-706896050-project Sep 02 05:36:58.367418 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: method: > Sep 02 05:36:58.367418 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: exception: Instance d19306c3-935d-4876-9adb-651da56d0574 could not be found. Sep 02 05:36:58.367418 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: action_args: {'id': 'd19306c3-935d-4876-9adb-651da56d0574'} Sep 02 05:36:58.368411 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:36:58.368411 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:36:58.368411 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:36:58.368411 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:36:58.368411 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:36:58.368411 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:36:58.368411 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:36:58.368411 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:36:58.368411 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:36:58.368411 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:36:58.368411 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d19306c3-935d-4876-9adb-651da56d0574 could not be found. Sep 02 05:36:58.368411 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:36:58.368411 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:36:58.368411 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:36:58.368411 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:36:58.368411 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:36:58.368411 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:36:58.368411 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:36:58.368411 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:36:58.368411 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:36:58.370004 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:36:58.370004 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:36:58.370004 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:36:58.370004 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:36:58.370004 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:36:58.370004 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:36:58.370004 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:36:58.370004 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d19306c3-935d-4876-9adb-651da56d0574 could not be found. Sep 02 05:36:58.370004 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:36:58.370004 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:36:58.370004 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:36:58.370004 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:36:58.370004 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:36:58.370004 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:36:58.370004 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:36:58.370004 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:36:58.370004 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d19306c3-935d-4876-9adb-651da56d0574 could not be found. Sep 02 05:36:58.370004 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:36:58.371593 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-167e08a4-4df9-413e-ac6e-a8d3766f2517 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Returning 404 to user: Instance d19306c3-935d-4876-9adb-651da56d0574 could not be found. {{(pid=120448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:36:58.371593 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-167e08a4-4df9-413e-ac6e-a8d3766f2517 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 404 len: 111 microversion: 2.1 time: 0.031832 Sep 02 05:36:58.371593 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 698/1398] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:36:58 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:36:58.376024 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-108f80f9-9117-4ebb-ad4b-0bba25ee05cf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '.version_select at 0x7fc90b0f8ca0>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:36:58.381057 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 05:36:58.381330 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Fri Sep 2 05:36:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-918377955 (ip 10.222.0.30) !!! Sep 02 05:36:58.402626 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-108f80f9-9117-4ebb-ad4b-0bba25ee05cf tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-918377955" status: 202 len: 0 microversion: 2.1 time: 0.030179 Sep 02 05:36:58.403614 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 701/1399] 10.222.0.30 () {58 vars in 1218 bytes} [Fri Sep 2 05:36:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-918377955 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:37:01.359336 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-12889f77-259e-4d3f-844c-5fe62bf9490a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:37:01.359866 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-12889f77-259e-4d3f-844c-5fe62bf9490a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:37:01.367186 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-12889f77-259e-4d3f-844c-5fe62bf9490a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:37:01.367667 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-12889f77-259e-4d3f-844c-5fe62bf9490a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:37:01.368106 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-12889f77-259e-4d3f-844c-5fe62bf9490a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:37:01.368820 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-12889f77-259e-4d3f-844c-5fe62bf9490a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:37:01.369271 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-12889f77-259e-4d3f-844c-5fe62bf9490a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:37:01.369681 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-12889f77-259e-4d3f-844c-5fe62bf9490a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:37:01.383288 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.wsgi [None req-12889f77-259e-4d3f-844c-5fe62bf9490a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] HTTP exception thrown: Instance d19306c3-935d-4876-9adb-651da56d0574 could not be found. Sep 02 05:37:01.384896 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-12889f77-259e-4d3f-844c-5fe62bf9490a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Request method failure captured: Sep 02 05:37:01.384896 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: request: DELETE /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 HTTP/1.1 Sep 02 05:37:01.384896 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept: application/json Sep 02 05:37:01.384896 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept-Encoding: identity Sep 02 05:37:01.384896 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Connection: close Sep 02 05:37:01.384896 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Length: 0 Sep 02 05:37:01.384896 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Type: application/json Sep 02 05:37:01.384896 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Host: 10.222.0.30 Sep 02 05:37:01.384896 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Openstack-System-Scope: None Sep 02 05:37:01.384896 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: User-Agent: python-urllib3/1.26.12 Sep 02 05:37:01.384896 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Auth-Token: gAAAAABjEZO5ixJTZLz6GGk-3Cr-UsnGjf2fgRdovThyegYcUwGTIuBtMMuCdgeKbQJIaRTwe1ps114Qxla8kszN3d3AeK9Ge4SGm55AldIpFwEAQsLBxnADifS_DFBEUjAuZ9KNqgx7fINlHDitlJoBTKxbiT90OE1W6K8UclbDQ4rqPrHqm2A Sep 02 05:37:01.384896 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Id: None Sep 02 05:37:01.384896 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Name: None Sep 02 05:37:01.384896 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Identity-Status: Confirmed Sep 02 05:37:01.384896 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Is-Admin-Project: True Sep 02 05:37:01.384896 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Id: default Sep 02 05:37:01.384896 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Name: Default Sep 02 05:37:01.384896 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Id: 88b420db5aef422b9ea85708c2d8e108 Sep 02 05:37:01.384896 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Name: tempest-AttachVolumeTestJSON-706896050 Sep 02 05:37:01.384896 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Role: member,reader Sep 02 05:37:01.384896 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Roles: member,reader Sep 02 05:37:01.386534 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_88b420db5aef422b9ea85708c2d8e108"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/88b420db5aef422b9ea85708c2d8e108"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/88b420db5aef422b9ea85708c2d8e108"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/88b420db5aef422b9ea85708c2d8e108"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:37:01.386534 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant: tempest-AttachVolumeTestJSON-706896050 Sep 02 05:37:01.386534 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Id: 88b420db5aef422b9ea85708c2d8e108 Sep 02 05:37:01.386534 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Name: tempest-AttachVolumeTestJSON-706896050 Sep 02 05:37:01.386534 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User: tempest-AttachVolumeTestJSON-706896050-project Sep 02 05:37:01.386534 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Id: default Sep 02 05:37:01.386534 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Name: Default Sep 02 05:37:01.386534 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Id: bdba1dc4a5e9482cb4eb94d914c108bf Sep 02 05:37:01.386534 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Name: tempest-AttachVolumeTestJSON-706896050-project Sep 02 05:37:01.386534 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: method: > Sep 02 05:37:01.386534 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: exception: Instance d19306c3-935d-4876-9adb-651da56d0574 could not be found. Sep 02 05:37:01.386534 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: action_args: {'id': 'd19306c3-935d-4876-9adb-651da56d0574'} Sep 02 05:37:01.387645 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:37:01.387645 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:37:01.387645 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:37:01.387645 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:37:01.387645 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:37:01.387645 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:37:01.387645 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:37:01.387645 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:37:01.387645 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:37:01.387645 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:37:01.387645 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d19306c3-935d-4876-9adb-651da56d0574 could not be found. Sep 02 05:37:01.387645 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:37:01.387645 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:37:01.387645 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:37:01.387645 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:37:01.387645 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:37:01.387645 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:37:01.387645 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:37:01.387645 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:37:01.387645 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:37:01.389239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:37:01.389239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 05:37:01.389239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 05:37:01.389239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 05:37:01.389239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 05:37:01.389239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:37:01.389239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:37:01.389239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:37:01.389239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:37:01.389239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d19306c3-935d-4876-9adb-651da56d0574 could not be found. Sep 02 05:37:01.389239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:37:01.389239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:37:01.389239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:37:01.389239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:37:01.389239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:37:01.389239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:37:01.389239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:37:01.389239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:37:01.389239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d19306c3-935d-4876-9adb-651da56d0574 could not be found. Sep 02 05:37:01.389239 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:37:01.390911 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-12889f77-259e-4d3f-844c-5fe62bf9490a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Returning 404 to user: Instance d19306c3-935d-4876-9adb-651da56d0574 could not be found. {{(pid=120448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:37:01.390911 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-12889f77-259e-4d3f-844c-5fe62bf9490a tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 404 len: 111 microversion: 2.1 time: 0.030921 Sep 02 05:37:01.390911 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 699/1400] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Sep 2 05:37:01 2022] DELETE /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:37:01.395349 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ee278a28-533b-422c-b095-3f4292203473 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:37:01.395946 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-ee278a28-533b-422c-b095-3f4292203473 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: d19306c3-935d-4876-9adb-651da56d0574] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:37:01.402708 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ee278a28-533b-422c-b095-3f4292203473 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:37:01.403192 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ee278a28-533b-422c-b095-3f4292203473 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:37:01.403621 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ee278a28-533b-422c-b095-3f4292203473 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:37:01.404363 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ee278a28-533b-422c-b095-3f4292203473 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:37:01.404809 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ee278a28-533b-422c-b095-3f4292203473 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:37:01.405225 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-ee278a28-533b-422c-b095-3f4292203473 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:37:01.419687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.wsgi [None req-ee278a28-533b-422c-b095-3f4292203473 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] HTTP exception thrown: Instance d19306c3-935d-4876-9adb-651da56d0574 could not be found. Sep 02 05:37:01.421400 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ee278a28-533b-422c-b095-3f4292203473 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Request method failure captured: Sep 02 05:37:01.421400 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: request: GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 HTTP/1.1 Sep 02 05:37:01.421400 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept: application/json Sep 02 05:37:01.421400 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept-Encoding: identity Sep 02 05:37:01.421400 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Connection: close Sep 02 05:37:01.421400 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Length: 0 Sep 02 05:37:01.421400 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Type: application/json Sep 02 05:37:01.421400 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Host: 10.222.0.30 Sep 02 05:37:01.421400 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Openstack-System-Scope: None Sep 02 05:37:01.421400 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: User-Agent: python-urllib3/1.26.12 Sep 02 05:37:01.421400 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Auth-Token: gAAAAABjEZO5ixJTZLz6GGk-3Cr-UsnGjf2fgRdovThyegYcUwGTIuBtMMuCdgeKbQJIaRTwe1ps114Qxla8kszN3d3AeK9Ge4SGm55AldIpFwEAQsLBxnADifS_DFBEUjAuZ9KNqgx7fINlHDitlJoBTKxbiT90OE1W6K8UclbDQ4rqPrHqm2A Sep 02 05:37:01.421400 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Id: None Sep 02 05:37:01.421400 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Name: None Sep 02 05:37:01.421400 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Identity-Status: Confirmed Sep 02 05:37:01.421400 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Is-Admin-Project: True Sep 02 05:37:01.421400 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Id: default Sep 02 05:37:01.421400 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Name: Default Sep 02 05:37:01.421400 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Id: 88b420db5aef422b9ea85708c2d8e108 Sep 02 05:37:01.421400 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Name: tempest-AttachVolumeTestJSON-706896050 Sep 02 05:37:01.421400 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Role: member,reader Sep 02 05:37:01.421400 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Roles: member,reader Sep 02 05:37:01.423198 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_88b420db5aef422b9ea85708c2d8e108"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/88b420db5aef422b9ea85708c2d8e108"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/88b420db5aef422b9ea85708c2d8e108"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/88b420db5aef422b9ea85708c2d8e108"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:37:01.423198 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant: tempest-AttachVolumeTestJSON-706896050 Sep 02 05:37:01.423198 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Id: 88b420db5aef422b9ea85708c2d8e108 Sep 02 05:37:01.423198 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Name: tempest-AttachVolumeTestJSON-706896050 Sep 02 05:37:01.423198 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User: tempest-AttachVolumeTestJSON-706896050-project Sep 02 05:37:01.423198 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Id: default Sep 02 05:37:01.423198 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Name: Default Sep 02 05:37:01.423198 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Id: bdba1dc4a5e9482cb4eb94d914c108bf Sep 02 05:37:01.423198 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Name: tempest-AttachVolumeTestJSON-706896050-project Sep 02 05:37:01.423198 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: method: > Sep 02 05:37:01.423198 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: exception: Instance d19306c3-935d-4876-9adb-651da56d0574 could not be found. Sep 02 05:37:01.423198 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: action_args: {'id': 'd19306c3-935d-4876-9adb-651da56d0574'} Sep 02 05:37:01.424375 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:37:01.424375 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:37:01.424375 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:37:01.424375 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:37:01.424375 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:37:01.424375 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:37:01.424375 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:37:01.424375 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:37:01.424375 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:37:01.424375 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:37:01.424375 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d19306c3-935d-4876-9adb-651da56d0574 could not be found. Sep 02 05:37:01.424375 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:37:01.424375 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:37:01.424375 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:37:01.424375 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:37:01.424375 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:37:01.424375 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:37:01.424375 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:37:01.424375 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:37:01.424375 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:37:01.426264 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:37:01.426264 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:37:01.426264 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:37:01.426264 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:37:01.426264 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:37:01.426264 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:37:01.426264 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:37:01.426264 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d19306c3-935d-4876-9adb-651da56d0574 could not be found. Sep 02 05:37:01.426264 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:37:01.426264 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:37:01.426264 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:37:01.426264 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:37:01.426264 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:37:01.426264 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:37:01.426264 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:37:01.426264 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:37:01.426264 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d19306c3-935d-4876-9adb-651da56d0574 could not be found. Sep 02 05:37:01.426264 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:37:01.427751 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ee278a28-533b-422c-b095-3f4292203473 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Returning 404 to user: Instance d19306c3-935d-4876-9adb-651da56d0574 could not be found. {{(pid=120449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:37:01.427751 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-ee278a28-533b-422c-b095-3f4292203473 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574" status: 404 len: 111 microversion: 2.1 time: 0.032182 Sep 02 05:37:01.427751 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 702/1401] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:37:01 2022] GET /compute/v2.1/servers/d19306c3-935d-4876-9adb-651da56d0574 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:37:02.586474 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-77a55289-9bc7-44ad-83f1-ad37f40562bc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:37:02.587017 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-77a55289-9bc7-44ad-83f1-ad37f40562bc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:37:02.594515 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-77a55289-9bc7-44ad-83f1-ad37f40562bc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:37:02.595010 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-77a55289-9bc7-44ad-83f1-ad37f40562bc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:37:02.595440 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-77a55289-9bc7-44ad-83f1-ad37f40562bc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:37:02.596222 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-77a55289-9bc7-44ad-83f1-ad37f40562bc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:37:02.596671 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-77a55289-9bc7-44ad-83f1-ad37f40562bc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:37:02.597091 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-77a55289-9bc7-44ad-83f1-ad37f40562bc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:37:02.610764 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.wsgi [None req-77a55289-9bc7-44ad-83f1-ad37f40562bc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] HTTP exception thrown: Instance 387fc985-a99f-4805-ab55-641d3fe7cc27 could not be found. Sep 02 05:37:02.612851 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-77a55289-9bc7-44ad-83f1-ad37f40562bc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Request method failure captured: Sep 02 05:37:02.612851 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: request: DELETE /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 HTTP/1.1 Sep 02 05:37:02.612851 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept: application/json Sep 02 05:37:02.612851 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept-Encoding: identity Sep 02 05:37:02.612851 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Connection: close Sep 02 05:37:02.612851 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Length: 0 Sep 02 05:37:02.612851 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Type: application/json Sep 02 05:37:02.612851 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Host: 10.222.0.30 Sep 02 05:37:02.612851 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Openstack-System-Scope: None Sep 02 05:37:02.612851 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: User-Agent: python-urllib3/1.26.12 Sep 02 05:37:02.612851 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Auth-Token: gAAAAABjEZO5ixJTZLz6GGk-3Cr-UsnGjf2fgRdovThyegYcUwGTIuBtMMuCdgeKbQJIaRTwe1ps114Qxla8kszN3d3AeK9Ge4SGm55AldIpFwEAQsLBxnADifS_DFBEUjAuZ9KNqgx7fINlHDitlJoBTKxbiT90OE1W6K8UclbDQ4rqPrHqm2A Sep 02 05:37:02.612851 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Id: None Sep 02 05:37:02.612851 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Name: None Sep 02 05:37:02.612851 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Identity-Status: Confirmed Sep 02 05:37:02.612851 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Is-Admin-Project: True Sep 02 05:37:02.612851 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Id: default Sep 02 05:37:02.612851 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Name: Default Sep 02 05:37:02.612851 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Id: 88b420db5aef422b9ea85708c2d8e108 Sep 02 05:37:02.612851 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Name: tempest-AttachVolumeTestJSON-706896050 Sep 02 05:37:02.612851 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Role: member,reader Sep 02 05:37:02.612851 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Roles: member,reader Sep 02 05:37:02.614606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_88b420db5aef422b9ea85708c2d8e108"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/88b420db5aef422b9ea85708c2d8e108"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/88b420db5aef422b9ea85708c2d8e108"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/88b420db5aef422b9ea85708c2d8e108"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:37:02.614606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant: tempest-AttachVolumeTestJSON-706896050 Sep 02 05:37:02.614606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Id: 88b420db5aef422b9ea85708c2d8e108 Sep 02 05:37:02.614606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Name: tempest-AttachVolumeTestJSON-706896050 Sep 02 05:37:02.614606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User: tempest-AttachVolumeTestJSON-706896050-project Sep 02 05:37:02.614606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Id: default Sep 02 05:37:02.614606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Name: Default Sep 02 05:37:02.614606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Id: bdba1dc4a5e9482cb4eb94d914c108bf Sep 02 05:37:02.614606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Name: tempest-AttachVolumeTestJSON-706896050-project Sep 02 05:37:02.614606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: method: > Sep 02 05:37:02.614606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: exception: Instance 387fc985-a99f-4805-ab55-641d3fe7cc27 could not be found. Sep 02 05:37:02.614606 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: action_args: {'id': '387fc985-a99f-4805-ab55-641d3fe7cc27'} Sep 02 05:37:02.615460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:37:02.615460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:37:02.615460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:37:02.615460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:37:02.615460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:37:02.615460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:37:02.615460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:37:02.615460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:37:02.615460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:37:02.615460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:37:02.615460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 387fc985-a99f-4805-ab55-641d3fe7cc27 could not be found. Sep 02 05:37:02.615460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:37:02.615460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:37:02.615460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:37:02.615460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:37:02.615460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:37:02.615460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:37:02.615460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:37:02.615460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:37:02.615460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:37:02.617113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:37:02.617113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 05:37:02.617113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 05:37:02.617113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 05:37:02.617113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 05:37:02.617113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:37:02.617113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:37:02.617113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:37:02.617113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:37:02.617113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 387fc985-a99f-4805-ab55-641d3fe7cc27 could not be found. Sep 02 05:37:02.617113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:37:02.617113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:37:02.617113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:37:02.617113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:37:02.617113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:37:02.617113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:37:02.617113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:37:02.617113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:37:02.617113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 387fc985-a99f-4805-ab55-641d3fe7cc27 could not be found. Sep 02 05:37:02.617113 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:37:02.618674 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-77a55289-9bc7-44ad-83f1-ad37f40562bc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Returning 404 to user: Instance 387fc985-a99f-4805-ab55-641d3fe7cc27 could not be found. {{(pid=120448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:37:02.618674 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-77a55289-9bc7-44ad-83f1-ad37f40562bc tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "DELETE /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 404 len: 111 microversion: 2.1 time: 0.031730 Sep 02 05:37:02.618674 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 700/1402] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Sep 2 05:37:02 2022] DELETE /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:37:02.625157 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-e76c773f-322f-477f-a94b-341d92faaeb3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:37:02.625790 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-e76c773f-322f-477f-a94b-341d92faaeb3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] [instance: 387fc985-a99f-4805-ab55-641d3fe7cc27] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:37:02.633095 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e76c773f-322f-477f-a94b-341d92faaeb3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:37:02.633602 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e76c773f-322f-477f-a94b-341d92faaeb3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:37:02.634034 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e76c773f-322f-477f-a94b-341d92faaeb3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:37:02.634775 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e76c773f-322f-477f-a94b-341d92faaeb3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:37:02.635215 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e76c773f-322f-477f-a94b-341d92faaeb3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:37:02.635633 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-e76c773f-322f-477f-a94b-341d92faaeb3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:37:02.650118 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.wsgi [None req-e76c773f-322f-477f-a94b-341d92faaeb3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] HTTP exception thrown: Instance 387fc985-a99f-4805-ab55-641d3fe7cc27 could not be found. Sep 02 05:37:02.651653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-e76c773f-322f-477f-a94b-341d92faaeb3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Request method failure captured: Sep 02 05:37:02.651653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: request: GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 HTTP/1.1 Sep 02 05:37:02.651653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept: application/json Sep 02 05:37:02.651653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept-Encoding: identity Sep 02 05:37:02.651653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Connection: close Sep 02 05:37:02.651653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Length: 0 Sep 02 05:37:02.651653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Type: application/json Sep 02 05:37:02.651653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Host: 10.222.0.30 Sep 02 05:37:02.651653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Openstack-System-Scope: None Sep 02 05:37:02.651653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: User-Agent: python-urllib3/1.26.12 Sep 02 05:37:02.651653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Auth-Token: gAAAAABjEZO5ixJTZLz6GGk-3Cr-UsnGjf2fgRdovThyegYcUwGTIuBtMMuCdgeKbQJIaRTwe1ps114Qxla8kszN3d3AeK9Ge4SGm55AldIpFwEAQsLBxnADifS_DFBEUjAuZ9KNqgx7fINlHDitlJoBTKxbiT90OE1W6K8UclbDQ4rqPrHqm2A Sep 02 05:37:02.651653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Id: None Sep 02 05:37:02.651653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Name: None Sep 02 05:37:02.651653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Identity-Status: Confirmed Sep 02 05:37:02.651653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Is-Admin-Project: True Sep 02 05:37:02.651653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Id: default Sep 02 05:37:02.651653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Name: Default Sep 02 05:37:02.651653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Id: 88b420db5aef422b9ea85708c2d8e108 Sep 02 05:37:02.651653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Name: tempest-AttachVolumeTestJSON-706896050 Sep 02 05:37:02.651653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Role: member,reader Sep 02 05:37:02.651653 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Roles: member,reader Sep 02 05:37:02.653416 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_88b420db5aef422b9ea85708c2d8e108"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/88b420db5aef422b9ea85708c2d8e108"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/88b420db5aef422b9ea85708c2d8e108"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/88b420db5aef422b9ea85708c2d8e108"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:37:02.653416 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant: tempest-AttachVolumeTestJSON-706896050 Sep 02 05:37:02.653416 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Id: 88b420db5aef422b9ea85708c2d8e108 Sep 02 05:37:02.653416 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Name: tempest-AttachVolumeTestJSON-706896050 Sep 02 05:37:02.653416 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User: tempest-AttachVolumeTestJSON-706896050-project Sep 02 05:37:02.653416 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Id: default Sep 02 05:37:02.653416 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Name: Default Sep 02 05:37:02.653416 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Id: bdba1dc4a5e9482cb4eb94d914c108bf Sep 02 05:37:02.653416 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Name: tempest-AttachVolumeTestJSON-706896050-project Sep 02 05:37:02.653416 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: method: > Sep 02 05:37:02.653416 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: exception: Instance 387fc985-a99f-4805-ab55-641d3fe7cc27 could not be found. Sep 02 05:37:02.653416 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: action_args: {'id': '387fc985-a99f-4805-ab55-641d3fe7cc27'} Sep 02 05:37:02.654473 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:37:02.654473 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:37:02.654473 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:37:02.654473 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:37:02.654473 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:37:02.654473 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:37:02.654473 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:37:02.654473 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:37:02.654473 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:37:02.654473 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:37:02.654473 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 387fc985-a99f-4805-ab55-641d3fe7cc27 could not be found. Sep 02 05:37:02.654473 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:37:02.654473 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:37:02.654473 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:37:02.654473 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:37:02.654473 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:37:02.654473 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:37:02.654473 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:37:02.654473 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:37:02.654473 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:37:02.656089 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:37:02.656089 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:37:02.656089 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:37:02.656089 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:37:02.656089 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:37:02.656089 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:37:02.656089 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:37:02.656089 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 387fc985-a99f-4805-ab55-641d3fe7cc27 could not be found. Sep 02 05:37:02.656089 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:37:02.656089 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:37:02.656089 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:37:02.656089 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:37:02.656089 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:37:02.656089 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:37:02.656089 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:37:02.656089 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:37:02.656089 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 387fc985-a99f-4805-ab55-641d3fe7cc27 could not be found. Sep 02 05:37:02.656089 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:37:02.657668 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-e76c773f-322f-477f-a94b-341d92faaeb3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] Returning 404 to user: Instance 387fc985-a99f-4805-ab55-641d3fe7cc27 could not be found. {{(pid=120449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:37:02.657668 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-e76c773f-322f-477f-a94b-341d92faaeb3 tempest-AttachVolumeTestJSON-706896050 tempest-AttachVolumeTestJSON-706896050-project] 10.222.0.30 "GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27" status: 404 len: 111 microversion: 2.1 time: 0.034007 Sep 02 05:37:02.657668 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 703/1403] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:37:02 2022] GET /compute/v2.1/servers/387fc985-a99f-4805-ab55-641d3fe7cc27 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:38:08.690385 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=13 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:38:08.691161 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:38:08.695204 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-70ff3417-c4c6-49a0-b4cf-b729eef15e4c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-974391209", "imageRef": "f3669111-2e3f-4f39-878f-19d263505eaa", "flavorRef": "452"}} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:38:08.912465 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.network.neutron [None req-70ff3417-c4c6-49a0-b4cf-b729eef15e4c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] validate_networks() for None {{(pid=120448) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 05:38:09.190886 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-70ff3417-c4c6-49a0-b4cf-b729eef15e4c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Flavor limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 05:38:09.191309 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-70ff3417-c4c6-49a0-b4cf-b729eef15e4c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Image limits 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 05:38:09.191768 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-70ff3417-c4c6-49a0-b4cf-b729eef15e4c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Flavor pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 05:38:09.192167 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-70ff3417-c4c6-49a0-b4cf-b729eef15e4c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Image pref 0:0:0 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 05:38:09.192590 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.virt.hardware [None req-70ff3417-c4c6-49a0-b4cf-b729eef15e4c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 05:38:09.203614 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-70ff3417-c4c6-49a0-b4cf-b729eef15e4c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:09.204095 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-70ff3417-c4c6-49a0-b4cf-b729eef15e4c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:09.205378 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-70ff3417-c4c6-49a0-b4cf-b729eef15e4c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:09.206112 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-70ff3417-c4c6-49a0-b4cf-b729eef15e4c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:09.206601 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-70ff3417-c4c6-49a0-b4cf-b729eef15e4c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:09.207029 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-70ff3417-c4c6-49a0-b4cf-b729eef15e4c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:09.226382 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-70ff3417-c4c6-49a0-b4cf-b729eef15e4c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Getting quotas for project 078de3f4553345ca8d45dbd8cc2767d8. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 05:38:09.230814 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.quota [None req-70ff3417-c4c6-49a0-b4cf-b729eef15e4c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Getting quotas for user da80cf57c2d3429896d6a97922f26a28 and project 078de3f4553345ca8d45dbd8cc2767d8. Resources: {'ram', 'instances', 'cores'} {{(pid=120448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 05:38:09.242953 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-70ff3417-c4c6-49a0-b4cf-b729eef15e4c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Going to run 1 instances... {{(pid=120448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 05:38:09.245268 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-70ff3417-c4c6-49a0-b4cf-b729eef15e4c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] [instance: 737ae559-6254-4f49-9b5d-7e4dbbca41eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3669111-2e3f-4f39-878f-19d263505eaa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 05:38:09.293813 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-70ff3417-c4c6-49a0-b4cf-b729eef15e4c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605189 Sep 02 05:38:09.294454 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 701/1404] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Sep 2 05:38:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 05:38:09.303322 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:38:09.304094 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:38:09.308625 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-ed5e72cd-d64d-4ef6-a8b5-7492eaba994c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:38:09.313142 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-ed5e72cd-d64d-4ef6-a8b5-7492eaba994c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] [instance: 737ae559-6254-4f49-9b5d-7e4dbbca41eb] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:38:09.476521 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-ed5e72cd-d64d-4ef6-a8b5-7492eaba994c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80cf57c2d3429896d6a97922f26a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078de3f4553345ca8d45dbd8cc2767d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:38:09.483640 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-ed5e72cd-d64d-4ef6-a8b5-7492eaba994c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] 10.222.0.30 "GET /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb" status: 200 len: 1214 microversion: 2.1 time: 0.182166 Sep 02 05:38:09.484214 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 704/1405] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:38:09 2022] GET /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb => generated 1214 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:38:10.506327 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-e872001c-4c5e-4c41-babf-df9152b4ebd4 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:38:10.507016 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-e872001c-4c5e-4c41-babf-df9152b4ebd4 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] [instance: 737ae559-6254-4f49-9b5d-7e4dbbca41eb] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:38:10.514040 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e872001c-4c5e-4c41-babf-df9152b4ebd4 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:10.514525 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e872001c-4c5e-4c41-babf-df9152b4ebd4 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:10.514951 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e872001c-4c5e-4c41-babf-df9152b4ebd4 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:10.515665 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e872001c-4c5e-4c41-babf-df9152b4ebd4 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:10.516148 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e872001c-4c5e-4c41-babf-df9152b4ebd4 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:10.516551 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e872001c-4c5e-4c41-babf-df9152b4ebd4 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:10.580728 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-e872001c-4c5e-4c41-babf-df9152b4ebd4 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80cf57c2d3429896d6a97922f26a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078de3f4553345ca8d45dbd8cc2767d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:38:10.588902 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-e872001c-4c5e-4c41-babf-df9152b4ebd4 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] 10.222.0.30 "GET /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb" status: 200 len: 1274 microversion: 2.1 time: 0.086956 Sep 02 05:38:10.589352 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 702/1406] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:38:10 2022] GET /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:38:11.610021 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-77170758-d1ba-44df-8bb7-30afe9e0ae3b tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:38:11.610624 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-77170758-d1ba-44df-8bb7-30afe9e0ae3b tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] [instance: 737ae559-6254-4f49-9b5d-7e4dbbca41eb] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:38:11.618186 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-77170758-d1ba-44df-8bb7-30afe9e0ae3b tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:11.618671 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-77170758-d1ba-44df-8bb7-30afe9e0ae3b tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:11.619108 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-77170758-d1ba-44df-8bb7-30afe9e0ae3b tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:11.619797 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-77170758-d1ba-44df-8bb7-30afe9e0ae3b tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:11.620277 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-77170758-d1ba-44df-8bb7-30afe9e0ae3b tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:11.620696 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-77170758-d1ba-44df-8bb7-30afe9e0ae3b tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:11.774110 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-77170758-d1ba-44df-8bb7-30afe9e0ae3b tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80cf57c2d3429896d6a97922f26a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078de3f4553345ca8d45dbd8cc2767d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:38:11.781872 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-77170758-d1ba-44df-8bb7-30afe9e0ae3b tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] 10.222.0.30 "GET /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb" status: 200 len: 1314 microversion: 2.1 time: 0.175739 Sep 02 05:38:11.782442 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 705/1407] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:38:11 2022] GET /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:38:12.117224 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-dc7c0262-2814-4561-8f75-de6651a6bfa4 req-c90f83d9-51b3-458d-90d2-5ca53603c128 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "737ae559-6254-4f49-9b5d-7e4dbbca41eb", "tag": "c60afcde-630f-45ee-9c4b-7bde7b0282a2"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:38:12.127817 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-dc7c0262-2814-4561-8f75-de6651a6bfa4 req-c90f83d9-51b3-458d-90d2-5ca53603c128 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:12.128973 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-dc7c0262-2814-4561-8f75-de6651a6bfa4 req-c90f83d9-51b3-458d-90d2-5ca53603c128 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:12.129727 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-dc7c0262-2814-4561-8f75-de6651a6bfa4 req-c90f83d9-51b3-458d-90d2-5ca53603c128 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:12.145712 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-dc7c0262-2814-4561-8f75-de6651a6bfa4 req-c90f83d9-51b3-458d-90d2-5ca53603c128 service nova] Creating event network-changed:c60afcde-630f-45ee-9c4b-7bde7b0282a2 for instance 737ae559-6254-4f49-9b5d-7e4dbbca41eb on hv-cinder-85391 Sep 02 05:38:12.150766 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-dc7c0262-2814-4561-8f75-de6651a6bfa4 req-c90f83d9-51b3-458d-90d2-5ca53603c128 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037500 Sep 02 05:38:12.151593 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 703/1408] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:38:12.809596 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-90e5b130-d731-432c-86f2-9d17c3ce079c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:38:12.810469 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-90e5b130-d731-432c-86f2-9d17c3ce079c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] [instance: 737ae559-6254-4f49-9b5d-7e4dbbca41eb] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:38:12.819376 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-90e5b130-d731-432c-86f2-9d17c3ce079c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:12.819849 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-90e5b130-d731-432c-86f2-9d17c3ce079c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:12.820313 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-90e5b130-d731-432c-86f2-9d17c3ce079c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:12.820998 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-90e5b130-d731-432c-86f2-9d17c3ce079c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:12.821445 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-90e5b130-d731-432c-86f2-9d17c3ce079c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:12.821864 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-90e5b130-d731-432c-86f2-9d17c3ce079c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:12.958522 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-90e5b130-d731-432c-86f2-9d17c3ce079c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80cf57c2d3429896d6a97922f26a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078de3f4553345ca8d45dbd8cc2767d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:38:12.968906 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-90e5b130-d731-432c-86f2-9d17c3ce079c tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] 10.222.0.30 "GET /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb" status: 200 len: 1314 microversion: 2.1 time: 0.168080 Sep 02 05:38:12.969840 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 706/1409] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:38:12 2022] GET /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:38:13.993348 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-6f357aa5-c4a4-4ec8-a80f-f700470060dc tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:38:13.994053 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-6f357aa5-c4a4-4ec8-a80f-f700470060dc tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] [instance: 737ae559-6254-4f49-9b5d-7e4dbbca41eb] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:38:14.000773 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6f357aa5-c4a4-4ec8-a80f-f700470060dc tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:14.001246 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6f357aa5-c4a4-4ec8-a80f-f700470060dc tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:14.001680 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6f357aa5-c4a4-4ec8-a80f-f700470060dc tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:14.002364 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6f357aa5-c4a4-4ec8-a80f-f700470060dc tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:14.002811 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6f357aa5-c4a4-4ec8-a80f-f700470060dc tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:14.003270 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6f357aa5-c4a4-4ec8-a80f-f700470060dc tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:14.156481 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-6f357aa5-c4a4-4ec8-a80f-f700470060dc tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80cf57c2d3429896d6a97922f26a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078de3f4553345ca8d45dbd8cc2767d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:38:14.164798 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-6f357aa5-c4a4-4ec8-a80f-f700470060dc tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] 10.222.0.30 "GET /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb" status: 200 len: 1314 microversion: 2.1 time: 0.176348 Sep 02 05:38:14.165367 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 704/1410] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:38:13 2022] GET /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:38:15.190221 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-8b8d49d1-9a6a-4263-bf6e-37f69e365113 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:38:15.191172 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-8b8d49d1-9a6a-4263-bf6e-37f69e365113 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] [instance: 737ae559-6254-4f49-9b5d-7e4dbbca41eb] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:38:15.201987 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8b8d49d1-9a6a-4263-bf6e-37f69e365113 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:15.202778 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8b8d49d1-9a6a-4263-bf6e-37f69e365113 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:15.203493 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8b8d49d1-9a6a-4263-bf6e-37f69e365113 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:15.204676 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8b8d49d1-9a6a-4263-bf6e-37f69e365113 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:15.205419 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8b8d49d1-9a6a-4263-bf6e-37f69e365113 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:15.206117 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8b8d49d1-9a6a-4263-bf6e-37f69e365113 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:15.343333 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-8b8d49d1-9a6a-4263-bf6e-37f69e365113 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80cf57c2d3429896d6a97922f26a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078de3f4553345ca8d45dbd8cc2767d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:38:15.351585 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-8b8d49d1-9a6a-4263-bf6e-37f69e365113 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] 10.222.0.30 "GET /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb" status: 200 len: 1314 microversion: 2.1 time: 0.168107 Sep 02 05:38:15.352163 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 707/1411] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:38:15 2022] GET /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:38:16.373328 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-10611a5b-53c7-4ba0-8d42-989222f70a07 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:38:16.373939 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-10611a5b-53c7-4ba0-8d42-989222f70a07 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] [instance: 737ae559-6254-4f49-9b5d-7e4dbbca41eb] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:38:16.381034 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-10611a5b-53c7-4ba0-8d42-989222f70a07 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:16.381523 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-10611a5b-53c7-4ba0-8d42-989222f70a07 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:16.381958 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-10611a5b-53c7-4ba0-8d42-989222f70a07 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:16.382640 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-10611a5b-53c7-4ba0-8d42-989222f70a07 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:16.383093 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-10611a5b-53c7-4ba0-8d42-989222f70a07 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:16.383507 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-10611a5b-53c7-4ba0-8d42-989222f70a07 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:16.524297 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-10611a5b-53c7-4ba0-8d42-989222f70a07 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80cf57c2d3429896d6a97922f26a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078de3f4553345ca8d45dbd8cc2767d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:38:16.532227 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-10611a5b-53c7-4ba0-8d42-989222f70a07 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] 10.222.0.30 "GET /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb" status: 200 len: 1314 microversion: 2.1 time: 0.162800 Sep 02 05:38:16.532930 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 705/1412] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:38:16 2022] GET /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 05:38:17.555334 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-71e1261f-37f1-4099-bc14-ae61626606e6 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:38:17.555964 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-71e1261f-37f1-4099-bc14-ae61626606e6 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] [instance: 737ae559-6254-4f49-9b5d-7e4dbbca41eb] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:38:17.562851 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-71e1261f-37f1-4099-bc14-ae61626606e6 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:17.563337 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-71e1261f-37f1-4099-bc14-ae61626606e6 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:17.563772 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-71e1261f-37f1-4099-bc14-ae61626606e6 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:17.564500 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-71e1261f-37f1-4099-bc14-ae61626606e6 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:17.564948 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-71e1261f-37f1-4099-bc14-ae61626606e6 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:17.565367 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-71e1261f-37f1-4099-bc14-ae61626606e6 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:17.697655 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-71e1261f-37f1-4099-bc14-ae61626606e6 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80cf57c2d3429896d6a97922f26a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078de3f4553345ca8d45dbd8cc2767d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:38:17.705689 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-71e1261f-37f1-4099-bc14-ae61626606e6 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] 10.222.0.30 "GET /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb" status: 200 len: 1314 microversion: 2.1 time: 0.155010 Sep 02 05:38:17.706293 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 708/1413] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:38:17 2022] GET /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:38:18.246837 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-e7107f24-cf16-4511-9257-d27ab96db106 req-42c5d756-6aac-4d40-866c-5418d2a7cbfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "737ae559-6254-4f49-9b5d-7e4dbbca41eb", "name": "network-vif-plugged", "status": "completed", "tag": "c60afcde-630f-45ee-9c4b-7bde7b0282a2"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:38:18.258500 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-e7107f24-cf16-4511-9257-d27ab96db106 req-42c5d756-6aac-4d40-866c-5418d2a7cbfc service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:18.259082 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-e7107f24-cf16-4511-9257-d27ab96db106 req-42c5d756-6aac-4d40-866c-5418d2a7cbfc service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:18.259699 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-e7107f24-cf16-4511-9257-d27ab96db106 req-42c5d756-6aac-4d40-866c-5418d2a7cbfc service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:18.271332 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-e7107f24-cf16-4511-9257-d27ab96db106 req-42c5d756-6aac-4d40-866c-5418d2a7cbfc service nova] Creating event network-vif-plugged:c60afcde-630f-45ee-9c4b-7bde7b0282a2 for instance 737ae559-6254-4f49-9b5d-7e4dbbca41eb on hv-cinder-85391 Sep 02 05:38:18.276612 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-e7107f24-cf16-4511-9257-d27ab96db106 req-42c5d756-6aac-4d40-866c-5418d2a7cbfc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033798 Sep 02 05:38:18.277498 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 706/1414] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:38:18.727172 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-48a40fdb-5b93-49e5-a228-55b820baa6f1 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:38:18.727804 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-48a40fdb-5b93-49e5-a228-55b820baa6f1 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] [instance: 737ae559-6254-4f49-9b5d-7e4dbbca41eb] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:38:18.734825 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-48a40fdb-5b93-49e5-a228-55b820baa6f1 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:18.735314 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-48a40fdb-5b93-49e5-a228-55b820baa6f1 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:18.735747 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-48a40fdb-5b93-49e5-a228-55b820baa6f1 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:18.736780 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-48a40fdb-5b93-49e5-a228-55b820baa6f1 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:18.737731 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-48a40fdb-5b93-49e5-a228-55b820baa6f1 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:18.737731 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-48a40fdb-5b93-49e5-a228-55b820baa6f1 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:18.872056 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-48a40fdb-5b93-49e5-a228-55b820baa6f1 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80cf57c2d3429896d6a97922f26a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078de3f4553345ca8d45dbd8cc2767d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:38:18.881107 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-48a40fdb-5b93-49e5-a228-55b820baa6f1 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] 10.222.0.30 "GET /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb" status: 200 len: 1314 microversion: 2.1 time: 0.157915 Sep 02 05:38:18.881651 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 709/1415] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:38:18 2022] GET /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:38:19.902597 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell0:SELECT=2 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:38:19.903774 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell0:SELECT=6 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:38:19.911065 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f971c833-9290-4198-b471-841934750bfa tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:38:19.912318 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f971c833-9290-4198-b471-841934750bfa tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] [instance: 737ae559-6254-4f49-9b5d-7e4dbbca41eb] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:38:19.923736 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f971c833-9290-4198-b471-841934750bfa tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:19.924461 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f971c833-9290-4198-b471-841934750bfa tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:19.925211 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f971c833-9290-4198-b471-841934750bfa tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:19.926284 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f971c833-9290-4198-b471-841934750bfa tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:19.927073 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f971c833-9290-4198-b471-841934750bfa tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:19.927491 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f971c833-9290-4198-b471-841934750bfa tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:20.062827 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f971c833-9290-4198-b471-841934750bfa tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80cf57c2d3429896d6a97922f26a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078de3f4553345ca8d45dbd8cc2767d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:38:20.070646 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f971c833-9290-4198-b471-841934750bfa tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] 10.222.0.30 "GET /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb" status: 200 len: 1314 microversion: 2.1 time: 0.169842 Sep 02 05:38:20.071203 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 707/1416] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:38:19 2022] GET /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:38:21.095755 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-1e4b4d42-c926-4d1b-b119-9fde297bfaf0 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:38:21.096722 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-1e4b4d42-c926-4d1b-b119-9fde297bfaf0 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] [instance: 737ae559-6254-4f49-9b5d-7e4dbbca41eb] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:38:21.099758 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell0:SELECT=2 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:38:21.109327 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1e4b4d42-c926-4d1b-b119-9fde297bfaf0 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:21.110127 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1e4b4d42-c926-4d1b-b119-9fde297bfaf0 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:21.110849 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1e4b4d42-c926-4d1b-b119-9fde297bfaf0 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:21.112388 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1e4b4d42-c926-4d1b-b119-9fde297bfaf0 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:21.113142 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1e4b4d42-c926-4d1b-b119-9fde297bfaf0 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:21.113842 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-1e4b4d42-c926-4d1b-b119-9fde297bfaf0 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:21.246213 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-1e4b4d42-c926-4d1b-b119-9fde297bfaf0 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80cf57c2d3429896d6a97922f26a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078de3f4553345ca8d45dbd8cc2767d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:38:21.254087 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-1e4b4d42-c926-4d1b-b119-9fde297bfaf0 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] 10.222.0.30 "GET /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb" status: 200 len: 1464 microversion: 2.1 time: 0.165022 Sep 02 05:38:21.254658 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 710/1417] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:38:21 2022] GET /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb => generated 1464 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:38:21.299270 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-e9972957-bce8-45a7-8b2d-13abd2ff51e5 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:38:21.299769 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-e9972957-bce8-45a7-8b2d-13abd2ff51e5 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] [instance: 737ae559-6254-4f49-9b5d-7e4dbbca41eb] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:38:21.306428 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e9972957-bce8-45a7-8b2d-13abd2ff51e5 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:21.306907 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e9972957-bce8-45a7-8b2d-13abd2ff51e5 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:21.307337 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e9972957-bce8-45a7-8b2d-13abd2ff51e5 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:21.308019 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e9972957-bce8-45a7-8b2d-13abd2ff51e5 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:21.308492 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e9972957-bce8-45a7-8b2d-13abd2ff51e5 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:21.308924 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-e9972957-bce8-45a7-8b2d-13abd2ff51e5 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:21.335094 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-e9972957-bce8-45a7-8b2d-13abd2ff51e5 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] [instance: 737ae559-6254-4f49-9b5d-7e4dbbca41eb] Going to try to terminate instance {{(pid=120448) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 05:38:21.415026 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-e9972957-bce8-45a7-8b2d-13abd2ff51e5 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] 10.222.0.30 "DELETE /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb" status: 204 len: 0 microversion: 2.1 time: 0.119114 Sep 02 05:38:21.415837 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 708/1418] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Sep 2 05:38:21 2022] DELETE /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 05:38:21.424558 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-8bb82dd1-3c76-4190-8dc6-31618e7fc996 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:38:21.425300 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-8bb82dd1-3c76-4190-8dc6-31618e7fc996 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] [instance: 737ae559-6254-4f49-9b5d-7e4dbbca41eb] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:38:21.431559 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8bb82dd1-3c76-4190-8dc6-31618e7fc996 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:21.432041 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8bb82dd1-3c76-4190-8dc6-31618e7fc996 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:21.432510 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8bb82dd1-3c76-4190-8dc6-31618e7fc996 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:21.433201 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8bb82dd1-3c76-4190-8dc6-31618e7fc996 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:21.433646 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8bb82dd1-3c76-4190-8dc6-31618e7fc996 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:21.434062 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8bb82dd1-3c76-4190-8dc6-31618e7fc996 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:21.577608 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-8bb82dd1-3c76-4190-8dc6-31618e7fc996 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80cf57c2d3429896d6a97922f26a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078de3f4553345ca8d45dbd8cc2767d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:38:21.589984 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-8bb82dd1-3c76-4190-8dc6-31618e7fc996 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] 10.222.0.30 "GET /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb" status: 200 len: 1470 microversion: 2.1 time: 0.169194 Sep 02 05:38:21.590692 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 711/1419] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:38:21 2022] GET /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:38:22.616713 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-f6921e0e-4972-469a-b7b7-d91996bb3af7 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:38:22.617513 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-f6921e0e-4972-469a-b7b7-d91996bb3af7 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] [instance: 737ae559-6254-4f49-9b5d-7e4dbbca41eb] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:38:22.625077 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f6921e0e-4972-469a-b7b7-d91996bb3af7 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:22.625627 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f6921e0e-4972-469a-b7b7-d91996bb3af7 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:22.626096 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f6921e0e-4972-469a-b7b7-d91996bb3af7 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:22.626863 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f6921e0e-4972-469a-b7b7-d91996bb3af7 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:22.627366 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f6921e0e-4972-469a-b7b7-d91996bb3af7 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:22.627836 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-f6921e0e-4972-469a-b7b7-d91996bb3af7 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:22.764678 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-f6921e0e-4972-469a-b7b7-d91996bb3af7 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80cf57c2d3429896d6a97922f26a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078de3f4553345ca8d45dbd8cc2767d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:38:22.772942 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-f6921e0e-4972-469a-b7b7-d91996bb3af7 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] 10.222.0.30 "GET /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb" status: 200 len: 1470 microversion: 2.1 time: 0.163376 Sep 02 05:38:22.773529 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 709/1420] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:38:22 2022] GET /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:38:23.795037 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-26a2f118-b257-4136-af0c-a03b33057023 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:38:23.795688 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-26a2f118-b257-4136-af0c-a03b33057023 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] [instance: 737ae559-6254-4f49-9b5d-7e4dbbca41eb] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:38:23.803239 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-26a2f118-b257-4136-af0c-a03b33057023 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:23.803734 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-26a2f118-b257-4136-af0c-a03b33057023 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:23.804401 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-26a2f118-b257-4136-af0c-a03b33057023 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:23.805201 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-26a2f118-b257-4136-af0c-a03b33057023 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:23.809648 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-26a2f118-b257-4136-af0c-a03b33057023 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:23.810105 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-26a2f118-b257-4136-af0c-a03b33057023 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:23.844509 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-074f25c5-e62f-410a-9244-3a1e1d4e4239 req-401c7257-11c1-4bbe-a96a-143574a3b99a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "737ae559-6254-4f49-9b5d-7e4dbbca41eb", "name": "network-vif-deleted", "tag": "c60afcde-630f-45ee-9c4b-7bde7b0282a2"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:38:23.862358 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-074f25c5-e62f-410a-9244-3a1e1d4e4239 req-401c7257-11c1-4bbe-a96a-143574a3b99a service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:23.863321 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-074f25c5-e62f-410a-9244-3a1e1d4e4239 req-401c7257-11c1-4bbe-a96a-143574a3b99a service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:23.863753 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-074f25c5-e62f-410a-9244-3a1e1d4e4239 req-401c7257-11c1-4bbe-a96a-143574a3b99a service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:23.876528 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-074f25c5-e62f-410a-9244-3a1e1d4e4239 req-401c7257-11c1-4bbe-a96a-143574a3b99a service nova] Creating event network-vif-deleted:c60afcde-630f-45ee-9c4b-7bde7b0282a2 for instance 737ae559-6254-4f49-9b5d-7e4dbbca41eb on hv-cinder-85391 Sep 02 05:38:23.882132 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-074f25c5-e62f-410a-9244-3a1e1d4e4239 req-401c7257-11c1-4bbe-a96a-143574a3b99a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045461 Sep 02 05:38:23.883241 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 710/1421] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:38:23.890235 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-26a2f118-b257-4136-af0c-a03b33057023 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80cf57c2d3429896d6a97922f26a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078de3f4553345ca8d45dbd8cc2767d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:38:23.898561 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-26a2f118-b257-4136-af0c-a03b33057023 tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] 10.222.0.30 "GET /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb" status: 200 len: 1428 microversion: 2.1 time: 0.107720 Sep 02 05:38:23.899153 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 712/1422] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:38:23 2022] GET /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb => generated 1428 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:38:24.922753 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-cc95388d-3bfd-4714-a95e-4d6c159b269f tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:38:24.923678 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-cc95388d-3bfd-4714-a95e-4d6c159b269f tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] [instance: 737ae559-6254-4f49-9b5d-7e4dbbca41eb] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:38:24.931172 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cc95388d-3bfd-4714-a95e-4d6c159b269f tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:24.931647 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cc95388d-3bfd-4714-a95e-4d6c159b269f tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:24.932077 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cc95388d-3bfd-4714-a95e-4d6c159b269f tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:24.932822 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cc95388d-3bfd-4714-a95e-4d6c159b269f tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:24.933262 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cc95388d-3bfd-4714-a95e-4d6c159b269f tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:24.933678 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cc95388d-3bfd-4714-a95e-4d6c159b269f tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:24.947002 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.wsgi [None req-cc95388d-3bfd-4714-a95e-4d6c159b269f tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] HTTP exception thrown: Instance 737ae559-6254-4f49-9b5d-7e4dbbca41eb could not be found. Sep 02 05:38:24.948699 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-cc95388d-3bfd-4714-a95e-4d6c159b269f tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Request method failure captured: Sep 02 05:38:24.948699 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: request: GET /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb HTTP/1.1 Sep 02 05:38:24.948699 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept: application/json Sep 02 05:38:24.948699 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept-Encoding: identity Sep 02 05:38:24.948699 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Connection: close Sep 02 05:38:24.948699 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Length: 0 Sep 02 05:38:24.948699 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Type: application/json Sep 02 05:38:24.948699 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Host: 10.222.0.30 Sep 02 05:38:24.948699 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Openstack-System-Scope: None Sep 02 05:38:24.948699 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: User-Agent: python-urllib3/1.26.12 Sep 02 05:38:24.948699 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Auth-Token: gAAAAABjEZa_kBxDfnad7O60RxGZEtvxI6M16Sq6Pz6L-P1WZ1R6RRtESThctWboS1qkS96QDHN7w7Ywtp1xl-E0FbCe2pi9-QFvRP25j_KVwcm7wWhb67tLujNg0ZtUGbI6obaLBDHhk4Y4yQD8WVhS_8pbj515b8tjvvLECVHUNgr5rXUcyds Sep 02 05:38:24.948699 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Id: None Sep 02 05:38:24.948699 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Name: None Sep 02 05:38:24.948699 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Identity-Status: Confirmed Sep 02 05:38:24.948699 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Is-Admin-Project: True Sep 02 05:38:24.948699 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Id: default Sep 02 05:38:24.948699 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Name: Default Sep 02 05:38:24.948699 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Id: 078de3f4553345ca8d45dbd8cc2767d8 Sep 02 05:38:24.948699 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Name: tempest-VolumesNegativeTest-2113069818 Sep 02 05:38:24.948699 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Role: member,reader Sep 02 05:38:24.948699 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Roles: member,reader Sep 02 05:38:24.950484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_078de3f4553345ca8d45dbd8cc2767d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/078de3f4553345ca8d45dbd8cc2767d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/078de3f4553345ca8d45dbd8cc2767d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/078de3f4553345ca8d45dbd8cc2767d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:38:24.950484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant: tempest-VolumesNegativeTest-2113069818 Sep 02 05:38:24.950484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Id: 078de3f4553345ca8d45dbd8cc2767d8 Sep 02 05:38:24.950484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Name: tempest-VolumesNegativeTest-2113069818 Sep 02 05:38:24.950484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User: tempest-VolumesNegativeTest-2113069818-project Sep 02 05:38:24.950484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Id: default Sep 02 05:38:24.950484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Name: Default Sep 02 05:38:24.950484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Id: da80cf57c2d3429896d6a97922f26a28 Sep 02 05:38:24.950484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Name: tempest-VolumesNegativeTest-2113069818-project Sep 02 05:38:24.950484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: method: > Sep 02 05:38:24.950484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: exception: Instance 737ae559-6254-4f49-9b5d-7e4dbbca41eb could not be found. Sep 02 05:38:24.950484 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: action_args: {'id': '737ae559-6254-4f49-9b5d-7e4dbbca41eb'} Sep 02 05:38:24.951463 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:38:24.951463 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:38:24.951463 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:38:24.951463 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:38:24.951463 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:38:24.951463 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:38:24.951463 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:38:24.951463 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:38:24.951463 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:38:24.951463 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:38:24.951463 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 737ae559-6254-4f49-9b5d-7e4dbbca41eb could not be found. Sep 02 05:38:24.951463 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:38:24.951463 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:38:24.951463 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:38:24.951463 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:38:24.951463 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:38:24.951463 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:38:24.951463 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:38:24.951463 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:38:24.951463 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:38:24.953022 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:38:24.953022 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:38:24.953022 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:38:24.953022 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:38:24.953022 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:38:24.953022 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:38:24.953022 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:38:24.953022 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 737ae559-6254-4f49-9b5d-7e4dbbca41eb could not be found. Sep 02 05:38:24.953022 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:38:24.953022 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:38:24.953022 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:38:24.953022 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:38:24.953022 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:38:24.953022 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:38:24.953022 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:38:24.953022 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:38:24.953022 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 737ae559-6254-4f49-9b5d-7e4dbbca41eb could not be found. Sep 02 05:38:24.953022 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:38:24.954364 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-cc95388d-3bfd-4714-a95e-4d6c159b269f tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] Returning 404 to user: Instance 737ae559-6254-4f49-9b5d-7e4dbbca41eb could not be found. {{(pid=120448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:38:24.954364 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-cc95388d-3bfd-4714-a95e-4d6c159b269f tempest-VolumesNegativeTest-2113069818 tempest-VolumesNegativeTest-2113069818-project] 10.222.0.30 "GET /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb" status: 404 len: 111 microversion: 2.1 time: 0.033493 Sep 02 05:38:24.954364 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 711/1423] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:38:24 2022] GET /compute/v2.1/servers/737ae559-6254-4f49-9b5d-7e4dbbca41eb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:38:39.935207 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_api:SELECT=20 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:38:39.935959 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=48 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:38:40.175898 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-4cb5b845-7045-4ecb-9503-9fbdbc8d34a9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1775816835"}} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:38:40.176632 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-4cb5b845-7045-4ecb-9503-9fbdbc8d34a9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:38:40.186030 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4cb5b845-7045-4ecb-9503-9fbdbc8d34a9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:40.186583 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4cb5b845-7045-4ecb-9503-9fbdbc8d34a9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:40.187114 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4cb5b845-7045-4ecb-9503-9fbdbc8d34a9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:40.188178 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4cb5b845-7045-4ecb-9503-9fbdbc8d34a9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:40.188859 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4cb5b845-7045-4ecb-9503-9fbdbc8d34a9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:40.189450 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4cb5b845-7045-4ecb-9503-9fbdbc8d34a9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:40.324961 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.network.security_group_api [None req-4cb5b845-7045-4ecb-9503-9fbdbc8d34a9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Removing security group d520822f-098e-478c-9efa-90513790d68f from port 45c24232-6095-4cd2-8644-d456619c27ed Sep 02 05:38:40.651367 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-4cb5b845-7045-4ecb-9503-9fbdbc8d34a9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "POST /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba/action" status: 202 len: 0 microversion: 2.1 time: 0.720932 Sep 02 05:38:40.651980 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 713/1424] 10.222.0.30 () {60 vars in 1278 bytes} [Fri Sep 2 05:38:39 2022] POST /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba/action => generated 0 bytes in 722 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:38:40.659516 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-f3450def-6a83-436a-91c6-aa4bcac4e628 req-31ebfada-5690-48eb-ad9f-f5fd44d23372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1051c26e-620c-419e-8b92-69c6a09b79ba", "tag": "45c24232-6095-4cd2-8644-d456619c27ed"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:38:40.665031 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:38:40.665674 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:38:40.666914 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 05:38:40.667079 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Fri Sep 2 05:38:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.30) !!! Sep 02 05:38:40.676341 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-f3450def-6a83-436a-91c6-aa4bcac4e628 req-31ebfada-5690-48eb-ad9f-f5fd44d23372 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:40.676829 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-f3450def-6a83-436a-91c6-aa4bcac4e628 req-31ebfada-5690-48eb-ad9f-f5fd44d23372 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:40.677261 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-f3450def-6a83-436a-91c6-aa4bcac4e628 req-31ebfada-5690-48eb-ad9f-f5fd44d23372 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:40.692991 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-f3450def-6a83-436a-91c6-aa4bcac4e628 req-31ebfada-5690-48eb-ad9f-f5fd44d23372 service nova] Creating event network-changed:45c24232-6095-4cd2-8644-d456619c27ed for instance 1051c26e-620c-419e-8b92-69c6a09b79ba on hv-cinder-85391 Sep 02 05:38:40.698125 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-f3450def-6a83-436a-91c6-aa4bcac4e628 req-31ebfada-5690-48eb-ad9f-f5fd44d23372 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042445 Sep 02 05:38:40.699180 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 712/1425] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:38:42.112792 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-4267ff0f-bd86-4a01-a8d0-9f81fa912428 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:38:42.113419 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-4267ff0f-bd86-4a01-a8d0-9f81fa912428 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:38:42.113605 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-912bcef4-17c3-4f99-9d18-c31575a09f1d req-969ef16d-a412-4de9-bd9e-13dd46844700 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1051c26e-620c-419e-8b92-69c6a09b79ba", "tag": "45c24232-6095-4cd2-8644-d456619c27ed"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:38:42.120493 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4267ff0f-bd86-4a01-a8d0-9f81fa912428 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:42.121073 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4267ff0f-bd86-4a01-a8d0-9f81fa912428 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:42.121543 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4267ff0f-bd86-4a01-a8d0-9f81fa912428 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:42.122443 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4267ff0f-bd86-4a01-a8d0-9f81fa912428 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:42.122879 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4267ff0f-bd86-4a01-a8d0-9f81fa912428 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:42.123523 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-4267ff0f-bd86-4a01-a8d0-9f81fa912428 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:42.124353 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-912bcef4-17c3-4f99-9d18-c31575a09f1d req-969ef16d-a412-4de9-bd9e-13dd46844700 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:42.124875 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-912bcef4-17c3-4f99-9d18-c31575a09f1d req-969ef16d-a412-4de9-bd9e-13dd46844700 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:42.125672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-912bcef4-17c3-4f99-9d18-c31575a09f1d req-969ef16d-a412-4de9-bd9e-13dd46844700 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:42.137510 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-912bcef4-17c3-4f99-9d18-c31575a09f1d req-969ef16d-a412-4de9-bd9e-13dd46844700 service nova] Creating event network-changed:45c24232-6095-4cd2-8644-d456619c27ed for instance 1051c26e-620c-419e-8b92-69c6a09b79ba on hv-cinder-85391 Sep 02 05:38:42.142591 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-912bcef4-17c3-4f99-9d18-c31575a09f1d req-969ef16d-a412-4de9-bd9e-13dd46844700 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039177 Sep 02 05:38:42.143374 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 713/1426] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:38:42.210580 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.objects.instance [None req-4267ff0f-bd86-4a01-a8d0-9f81fa912428 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lazy-loading 'services' on Instance uuid 1051c26e-620c-419e-8b92-69c6a09b79ba {{(pid=120449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 05:38:42.293435 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-4267ff0f-bd86-4a01-a8d0-9f81fa912428 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba/os-volume_attachments/2820ea98-0cc6-4750-8556-17aca758c2a7" status: 202 len: 0 microversion: 2.1 time: 0.191863 Sep 02 05:38:42.294306 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 714/1427] 10.222.0.30 () {58 vars in 1416 bytes} [Fri Sep 2 05:38:42 2022] DELETE /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba/os-volume_attachments/2820ea98-0cc6-4750-8556-17aca758c2a7 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:38:42.303075 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-35ce1342-4cc7-4dfc-b794-0130cd3dce5d tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:38:42.305736 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-35ce1342-4cc7-4dfc-b794-0130cd3dce5d tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:38:42.312324 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-35ce1342-4cc7-4dfc-b794-0130cd3dce5d tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:42.312819 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-35ce1342-4cc7-4dfc-b794-0130cd3dce5d tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:42.313263 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-35ce1342-4cc7-4dfc-b794-0130cd3dce5d tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:42.314031 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-35ce1342-4cc7-4dfc-b794-0130cd3dce5d tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:42.314479 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-35ce1342-4cc7-4dfc-b794-0130cd3dce5d tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:42.314891 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-35ce1342-4cc7-4dfc-b794-0130cd3dce5d tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:42.346250 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-35ce1342-4cc7-4dfc-b794-0130cd3dce5d tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047175 Sep 02 05:38:42.346866 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 714/1428] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Sep 2 05:38:42 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:38:43.365056 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-8a45673f-a661-4e68-bcdd-f386d4017852 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:38:43.368956 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-8a45673f-a661-4e68-bcdd-f386d4017852 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:38:43.381370 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8a45673f-a661-4e68-bcdd-f386d4017852 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:43.382149 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8a45673f-a661-4e68-bcdd-f386d4017852 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:43.382889 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8a45673f-a661-4e68-bcdd-f386d4017852 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:43.383586 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8a45673f-a661-4e68-bcdd-f386d4017852 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:43.384037 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8a45673f-a661-4e68-bcdd-f386d4017852 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:43.384485 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-8a45673f-a661-4e68-bcdd-f386d4017852 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:43.415718 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-8a45673f-a661-4e68-bcdd-f386d4017852 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059616 Sep 02 05:38:43.416314 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 715/1429] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Sep 2 05:38:43 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:38:44.431682 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-6580ea32-80d3-4644-8db3-316d21465a93 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:38:44.433917 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-6580ea32-80d3-4644-8db3-316d21465a93 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:38:44.441066 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6580ea32-80d3-4644-8db3-316d21465a93 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:44.441555 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6580ea32-80d3-4644-8db3-316d21465a93 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:44.441992 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6580ea32-80d3-4644-8db3-316d21465a93 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:44.442676 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6580ea32-80d3-4644-8db3-316d21465a93 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:44.443136 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6580ea32-80d3-4644-8db3-316d21465a93 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:44.443562 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-6580ea32-80d3-4644-8db3-316d21465a93 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:44.472990 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-6580ea32-80d3-4644-8db3-316d21465a93 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047226 Sep 02 05:38:44.473563 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 715/1430] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Sep 2 05:38:44 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:38:45.485358 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-bcbc6a0a-4121-4ba4-8bf8-e0ffbc60f5d6 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:38:45.488304 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-bcbc6a0a-4121-4ba4-8bf8-e0ffbc60f5d6 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:38:45.495076 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bcbc6a0a-4121-4ba4-8bf8-e0ffbc60f5d6 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:45.495554 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bcbc6a0a-4121-4ba4-8bf8-e0ffbc60f5d6 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:45.495961 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bcbc6a0a-4121-4ba4-8bf8-e0ffbc60f5d6 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:45.496673 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bcbc6a0a-4121-4ba4-8bf8-e0ffbc60f5d6 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:45.497121 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bcbc6a0a-4121-4ba4-8bf8-e0ffbc60f5d6 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:45.497538 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-bcbc6a0a-4121-4ba4-8bf8-e0ffbc60f5d6 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:45.528861 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-bcbc6a0a-4121-4ba4-8bf8-e0ffbc60f5d6 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047583 Sep 02 05:38:45.529738 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 716/1431] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Sep 2 05:38:45 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:38:46.544274 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-dbe9c85a-9ed6-4414-8e30-706e6df0201e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:38:46.546875 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-dbe9c85a-9ed6-4414-8e30-706e6df0201e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:38:46.554970 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dbe9c85a-9ed6-4414-8e30-706e6df0201e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:46.555630 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dbe9c85a-9ed6-4414-8e30-706e6df0201e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:46.556068 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dbe9c85a-9ed6-4414-8e30-706e6df0201e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:46.556804 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dbe9c85a-9ed6-4414-8e30-706e6df0201e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:46.557259 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dbe9c85a-9ed6-4414-8e30-706e6df0201e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:46.557681 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-dbe9c85a-9ed6-4414-8e30-706e6df0201e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:46.588460 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-dbe9c85a-9ed6-4414-8e30-706e6df0201e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048942 Sep 02 05:38:46.589010 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 716/1432] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Sep 2 05:38:46 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:38:47.605548 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-89eca976-2070-4f31-aa1d-1056fa5cb89e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:38:47.608020 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-89eca976-2070-4f31-aa1d-1056fa5cb89e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:38:47.615923 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-89eca976-2070-4f31-aa1d-1056fa5cb89e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:47.616480 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-89eca976-2070-4f31-aa1d-1056fa5cb89e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:47.616956 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-89eca976-2070-4f31-aa1d-1056fa5cb89e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:47.617708 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-89eca976-2070-4f31-aa1d-1056fa5cb89e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:47.618203 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-89eca976-2070-4f31-aa1d-1056fa5cb89e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:47.618663 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-89eca976-2070-4f31-aa1d-1056fa5cb89e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:47.650930 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-89eca976-2070-4f31-aa1d-1056fa5cb89e tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050611 Sep 02 05:38:47.651402 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 717/1433] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Sep 2 05:38:47 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:38:48.667469 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-7168f071-b387-44f4-9c41-a77966442e19 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:38:48.671180 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-7168f071-b387-44f4-9c41-a77966442e19 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:38:48.679511 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7168f071-b387-44f4-9c41-a77966442e19 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:48.680048 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7168f071-b387-44f4-9c41-a77966442e19 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:48.680561 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7168f071-b387-44f4-9c41-a77966442e19 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:48.681321 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7168f071-b387-44f4-9c41-a77966442e19 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:48.681815 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7168f071-b387-44f4-9c41-a77966442e19 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:48.682305 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-7168f071-b387-44f4-9c41-a77966442e19 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:48.712478 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-7168f071-b387-44f4-9c41-a77966442e19 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051724 Sep 02 05:38:48.713139 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 717/1434] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Sep 2 05:38:48 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 05:38:48.723533 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-c4f705db-9db7-43e8-98ee-caa8c7cdcdfa tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:38:48.724067 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-c4f705db-9db7-43e8-98ee-caa8c7cdcdfa tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:38:48.730880 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c4f705db-9db7-43e8-98ee-caa8c7cdcdfa tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:48.731355 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c4f705db-9db7-43e8-98ee-caa8c7cdcdfa tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:48.731781 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c4f705db-9db7-43e8-98ee-caa8c7cdcdfa tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:48.732490 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c4f705db-9db7-43e8-98ee-caa8c7cdcdfa tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:48.732931 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c4f705db-9db7-43e8-98ee-caa8c7cdcdfa tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:48.733339 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c4f705db-9db7-43e8-98ee-caa8c7cdcdfa tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:48.808398 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.wsgi [None req-c4f705db-9db7-43e8-98ee-caa8c7cdcdfa tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] HTTP exception thrown: Instance 1051c26e-620c-419e-8b92-69c6a09b79ba is not attached to volume 2820ea98-0cc6-4750-8556-17aca758c2a7 Sep 02 05:38:48.813964 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-c4f705db-9db7-43e8-98ee-caa8c7cdcdfa tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Request method failure captured: Sep 02 05:38:48.813964 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: request: DELETE /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba/os-volume_attachments/2820ea98-0cc6-4750-8556-17aca758c2a7 HTTP/1.1 Sep 02 05:38:48.813964 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept: application/json Sep 02 05:38:48.813964 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept-Encoding: identity Sep 02 05:38:48.813964 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Connection: close Sep 02 05:38:48.813964 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Length: 0 Sep 02 05:38:48.813964 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Type: application/json Sep 02 05:38:48.813964 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Host: 10.222.0.30 Sep 02 05:38:48.813964 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Openstack-System-Scope: None Sep 02 05:38:48.813964 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: User-Agent: python-urllib3/1.26.12 Sep 02 05:38:48.813964 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Auth-Token: gAAAAABjEZWc1I3m-P7QTofuNfweCjSqCYJdlnvu-qH5UOXu5hs7AIt99gvsg9KSh-RZzArAn0zWxJKF1zxtAH423l75CSqqQ86IWO5rTmfUGRup_8o1qSD7lLYBShZKy8vC6cHj-_pGz_oJplfolZIlbYrqkCjIYGzllAD7VFz1OVyoP88r5ek Sep 02 05:38:48.813964 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Id: None Sep 02 05:38:48.813964 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Name: None Sep 02 05:38:48.813964 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Identity-Status: Confirmed Sep 02 05:38:48.813964 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Is-Admin-Project: True Sep 02 05:38:48.813964 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Id: default Sep 02 05:38:48.813964 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Name: Default Sep 02 05:38:48.813964 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Id: 4f5094f4d0894667b1d725d84b220858 Sep 02 05:38:48.813964 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Name: tempest-TestMinimumBasicScenario-72942750 Sep 02 05:38:48.813964 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Role: member,reader Sep 02 05:38:48.813964 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Roles: member,reader Sep 02 05:38:48.815673 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4f5094f4d0894667b1d725d84b220858"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4f5094f4d0894667b1d725d84b220858"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4f5094f4d0894667b1d725d84b220858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4f5094f4d0894667b1d725d84b220858"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:38:48.815673 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant: tempest-TestMinimumBasicScenario-72942750 Sep 02 05:38:48.815673 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Id: 4f5094f4d0894667b1d725d84b220858 Sep 02 05:38:48.815673 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Name: tempest-TestMinimumBasicScenario-72942750 Sep 02 05:38:48.815673 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User: tempest-TestMinimumBasicScenario-72942750-project Sep 02 05:38:48.815673 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Id: default Sep 02 05:38:48.815673 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Name: Default Sep 02 05:38:48.815673 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Id: 017b21a3715243ff90cc70b7e115a68c Sep 02 05:38:48.815673 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Name: tempest-TestMinimumBasicScenario-72942750-project Sep 02 05:38:48.815673 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: method: > Sep 02 05:38:48.815673 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: exception: Instance 1051c26e-620c-419e-8b92-69c6a09b79ba is not attached to volume 2820ea98-0cc6-4750-8556-17aca758c2a7 Sep 02 05:38:48.816727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: action_args: {'server_id': '1051c26e-620c-419e-8b92-69c6a09b79ba', 'id': '2820ea98-0cc6-4750-8556-17aca758c2a7'} Sep 02 05:38:48.816727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:38:48.816727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:38:48.816727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 02 05:38:48.816727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 02 05:38:48.816727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 05:38:48.816727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 05:38:48.816727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 02 05:38:48.816727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 02 05:38:48.816727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2820ea98-0cc6-4750-8556-17aca758c2a7. Sep 02 05:38:48.816727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:38:48.816727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:38:48.816727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:38:48.816727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:38:48.816727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:38:48.816727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:38:48.816727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:38:48.816727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:38:48.816727 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:38:48.818315 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:38:48.818315 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 02 05:38:48.818315 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 02 05:38:48.818315 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1051c26e-620c-419e-8b92-69c6a09b79ba is not attached to volume 2820ea98-0cc6-4750-8556-17aca758c2a7 Sep 02 05:38:48.818315 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:38:48.818315 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:38:48.818315 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:38:48.818315 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:38:48.818315 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:38:48.818315 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:38:48.818315 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:38:48.818315 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:38:48.818315 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1051c26e-620c-419e-8b92-69c6a09b79ba is not attached to volume 2820ea98-0cc6-4750-8556-17aca758c2a7 Sep 02 05:38:48.818315 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:38:48.818315 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-c4f705db-9db7-43e8-98ee-caa8c7cdcdfa tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Returning 404 to user: Instance 1051c26e-620c-419e-8b92-69c6a09b79ba is not attached to volume 2820ea98-0cc6-4750-8556-17aca758c2a7 {{(pid=120449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:38:48.819602 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-c4f705db-9db7-43e8-98ee-caa8c7cdcdfa tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba/os-volume_attachments/2820ea98-0cc6-4750-8556-17aca758c2a7" status: 404 len: 154 microversion: 2.1 time: 0.095860 Sep 02 05:38:48.819602 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 718/1435] 10.222.0.30 () {58 vars in 1416 bytes} [Fri Sep 2 05:38:48 2022] DELETE /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba/os-volume_attachments/2820ea98-0cc6-4750-8556-17aca758c2a7 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:38:49.968716 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-78427144-e7f6-4552-b2e1-16dd16e88850 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:38:49.969209 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-78427144-e7f6-4552-b2e1-16dd16e88850 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:38:49.975937 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-78427144-e7f6-4552-b2e1-16dd16e88850 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:49.976444 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-78427144-e7f6-4552-b2e1-16dd16e88850 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:49.976877 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-78427144-e7f6-4552-b2e1-16dd16e88850 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:49.977569 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-78427144-e7f6-4552-b2e1-16dd16e88850 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:49.978011 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-78427144-e7f6-4552-b2e1-16dd16e88850 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:49.978433 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-78427144-e7f6-4552-b2e1-16dd16e88850 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:50.003495 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-78427144-e7f6-4552-b2e1-16dd16e88850 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Going to try to terminate instance {{(pid=120448) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 05:38:50.090252 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-78427144-e7f6-4552-b2e1-16dd16e88850 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 204 len: 0 microversion: 2.1 time: 0.124952 Sep 02 05:38:50.091136 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 718/1436] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Sep 2 05:38:49 2022] DELETE /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 05:38:50.099561 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-11f6daaa-e196-478e-9f47-65d5dfa9eaf9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:38:50.100194 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-11f6daaa-e196-478e-9f47-65d5dfa9eaf9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:38:50.106950 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-11f6daaa-e196-478e-9f47-65d5dfa9eaf9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:50.107434 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-11f6daaa-e196-478e-9f47-65d5dfa9eaf9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:50.107867 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-11f6daaa-e196-478e-9f47-65d5dfa9eaf9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:50.108576 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-11f6daaa-e196-478e-9f47-65d5dfa9eaf9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:50.109031 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-11f6daaa-e196-478e-9f47-65d5dfa9eaf9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:50.109446 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-11f6daaa-e196-478e-9f47-65d5dfa9eaf9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:50.245646 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-11f6daaa-e196-478e-9f47-65d5dfa9eaf9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:38:50.253562 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-11f6daaa-e196-478e-9f47-65d5dfa9eaf9 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1554 microversion: 2.1 time: 0.157862 Sep 02 05:38:50.254140 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 719/1437] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:38:50 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:38:51.278830 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-2661f6cf-26b5-4536-9c34-e004f6e54050 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:38:51.279748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-2661f6cf-26b5-4536-9c34-e004f6e54050 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:38:51.289042 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2661f6cf-26b5-4536-9c34-e004f6e54050 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:51.289840 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2661f6cf-26b5-4536-9c34-e004f6e54050 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:51.290327 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2661f6cf-26b5-4536-9c34-e004f6e54050 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:51.291379 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2661f6cf-26b5-4536-9c34-e004f6e54050 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:51.292041 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2661f6cf-26b5-4536-9c34-e004f6e54050 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:51.292736 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-2661f6cf-26b5-4536-9c34-e004f6e54050 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:51.437224 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-2661f6cf-26b5-4536-9c34-e004f6e54050 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:38:51.449874 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-2661f6cf-26b5-4536-9c34-e004f6e54050 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1554 microversion: 2.1 time: 0.178118 Sep 02 05:38:51.450451 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 719/1438] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:38:51 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1554 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:38:52.471032 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-52f8d069-b06c-475c-8631-c78a5de0e314 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:38:52.471687 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-52f8d069-b06c-475c-8631-c78a5de0e314 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:38:52.478644 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-52f8d069-b06c-475c-8631-c78a5de0e314 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:52.479132 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-52f8d069-b06c-475c-8631-c78a5de0e314 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:52.479547 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-52f8d069-b06c-475c-8631-c78a5de0e314 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:52.480322 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-52f8d069-b06c-475c-8631-c78a5de0e314 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:52.480778 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-52f8d069-b06c-475c-8631-c78a5de0e314 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:52.481201 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-52f8d069-b06c-475c-8631-c78a5de0e314 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:52.612294 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-52f8d069-b06c-475c-8631-c78a5de0e314 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b21a3715243ff90cc70b7e115a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5094f4d0894667b1d725d84b220858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:38:52.621802 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-52f8d069-b06c-475c-8631-c78a5de0e314 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 200 len: 1554 microversion: 2.1 time: 0.154681 Sep 02 05:38:52.634305 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 720/1439] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:38:52 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:38:52.717487 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-20994984-2b9e-48e7-b31e-aee56f0d0b9a req-6e045602-2ddd-4b0c-806b-58c9b94b68f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1051c26e-620c-419e-8b92-69c6a09b79ba", "name": "network-vif-deleted", "tag": "45c24232-6095-4cd2-8644-d456619c27ed"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:38:52.727681 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-20994984-2b9e-48e7-b31e-aee56f0d0b9a req-6e045602-2ddd-4b0c-806b-58c9b94b68f4 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:52.728181 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-20994984-2b9e-48e7-b31e-aee56f0d0b9a req-6e045602-2ddd-4b0c-806b-58c9b94b68f4 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:52.728617 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-20994984-2b9e-48e7-b31e-aee56f0d0b9a req-6e045602-2ddd-4b0c-806b-58c9b94b68f4 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:52.740800 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-20994984-2b9e-48e7-b31e-aee56f0d0b9a req-6e045602-2ddd-4b0c-806b-58c9b94b68f4 service nova] Creating event network-vif-deleted:45c24232-6095-4cd2-8644-d456619c27ed for instance 1051c26e-620c-419e-8b92-69c6a09b79ba on hv-cinder-85391 Sep 02 05:38:52.745745 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-20994984-2b9e-48e7-b31e-aee56f0d0b9a req-6e045602-2ddd-4b0c-806b-58c9b94b68f4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032627 Sep 02 05:38:52.746418 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 720/1440] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:38:53.646693 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-17cb1cdb-3c10-42b7-a5e7-1e83ad99939f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:38:53.647657 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-17cb1cdb-3c10-42b7-a5e7-1e83ad99939f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] [instance: 1051c26e-620c-419e-8b92-69c6a09b79ba] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:38:53.657273 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-17cb1cdb-3c10-42b7-a5e7-1e83ad99939f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:53.657756 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-17cb1cdb-3c10-42b7-a5e7-1e83ad99939f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:53.658190 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-17cb1cdb-3c10-42b7-a5e7-1e83ad99939f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:53.658871 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-17cb1cdb-3c10-42b7-a5e7-1e83ad99939f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:38:53.659333 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-17cb1cdb-3c10-42b7-a5e7-1e83ad99939f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:38:53.659756 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-17cb1cdb-3c10-42b7-a5e7-1e83ad99939f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:38:53.673728 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.wsgi [None req-17cb1cdb-3c10-42b7-a5e7-1e83ad99939f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] HTTP exception thrown: Instance 1051c26e-620c-419e-8b92-69c6a09b79ba could not be found. Sep 02 05:38:53.675254 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-17cb1cdb-3c10-42b7-a5e7-1e83ad99939f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Request method failure captured: Sep 02 05:38:53.675254 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: request: GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba HTTP/1.1 Sep 02 05:38:53.675254 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept: application/json Sep 02 05:38:53.675254 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept-Encoding: identity Sep 02 05:38:53.675254 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Connection: close Sep 02 05:38:53.675254 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Length: 0 Sep 02 05:38:53.675254 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Type: application/json Sep 02 05:38:53.675254 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Host: 10.222.0.30 Sep 02 05:38:53.675254 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Openstack-System-Scope: None Sep 02 05:38:53.675254 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: User-Agent: python-urllib3/1.26.12 Sep 02 05:38:53.675254 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Auth-Token: gAAAAABjEZWc1I3m-P7QTofuNfweCjSqCYJdlnvu-qH5UOXu5hs7AIt99gvsg9KSh-RZzArAn0zWxJKF1zxtAH423l75CSqqQ86IWO5rTmfUGRup_8o1qSD7lLYBShZKy8vC6cHj-_pGz_oJplfolZIlbYrqkCjIYGzllAD7VFz1OVyoP88r5ek Sep 02 05:38:53.675254 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Id: None Sep 02 05:38:53.675254 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Name: None Sep 02 05:38:53.675254 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Identity-Status: Confirmed Sep 02 05:38:53.675254 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Is-Admin-Project: True Sep 02 05:38:53.675254 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Id: default Sep 02 05:38:53.675254 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Name: Default Sep 02 05:38:53.675254 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Id: 4f5094f4d0894667b1d725d84b220858 Sep 02 05:38:53.675254 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Name: tempest-TestMinimumBasicScenario-72942750 Sep 02 05:38:53.675254 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Role: member,reader Sep 02 05:38:53.675254 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Roles: member,reader Sep 02 05:38:53.677745 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4f5094f4d0894667b1d725d84b220858"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4f5094f4d0894667b1d725d84b220858"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4f5094f4d0894667b1d725d84b220858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4f5094f4d0894667b1d725d84b220858"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:38:53.677745 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant: tempest-TestMinimumBasicScenario-72942750 Sep 02 05:38:53.677745 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Id: 4f5094f4d0894667b1d725d84b220858 Sep 02 05:38:53.677745 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Name: tempest-TestMinimumBasicScenario-72942750 Sep 02 05:38:53.677745 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User: tempest-TestMinimumBasicScenario-72942750-project Sep 02 05:38:53.677745 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Id: default Sep 02 05:38:53.677745 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Name: Default Sep 02 05:38:53.677745 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Id: 017b21a3715243ff90cc70b7e115a68c Sep 02 05:38:53.677745 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Name: tempest-TestMinimumBasicScenario-72942750-project Sep 02 05:38:53.677745 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: method: > Sep 02 05:38:53.677745 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: exception: Instance 1051c26e-620c-419e-8b92-69c6a09b79ba could not be found. Sep 02 05:38:53.677745 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: action_args: {'id': '1051c26e-620c-419e-8b92-69c6a09b79ba'} Sep 02 05:38:53.679246 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:38:53.679246 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:38:53.679246 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:38:53.679246 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:38:53.679246 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:38:53.679246 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:38:53.679246 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:38:53.679246 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:38:53.679246 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:38:53.679246 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:38:53.679246 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1051c26e-620c-419e-8b92-69c6a09b79ba could not be found. Sep 02 05:38:53.679246 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:38:53.679246 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:38:53.679246 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:38:53.679246 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:38:53.679246 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:38:53.679246 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:38:53.679246 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:38:53.679246 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:38:53.679246 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:38:53.680965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:38:53.680965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:38:53.680965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:38:53.680965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:38:53.680965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:38:53.680965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:38:53.680965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:38:53.680965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1051c26e-620c-419e-8b92-69c6a09b79ba could not be found. Sep 02 05:38:53.680965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:38:53.680965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:38:53.680965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:38:53.680965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:38:53.680965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:38:53.680965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:38:53.680965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:38:53.680965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:38:53.680965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1051c26e-620c-419e-8b92-69c6a09b79ba could not be found. Sep 02 05:38:53.680965 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:38:53.682554 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-17cb1cdb-3c10-42b7-a5e7-1e83ad99939f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Returning 404 to user: Instance 1051c26e-620c-419e-8b92-69c6a09b79ba could not be found. {{(pid=120449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:38:53.682554 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-17cb1cdb-3c10-42b7-a5e7-1e83ad99939f tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba" status: 404 len: 111 microversion: 2.1 time: 0.036665 Sep 02 05:38:53.682554 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 721/1441] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:38:53 2022] GET /compute/v2.1/servers/1051c26e-620c-419e-8b92-69c6a09b79ba => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:38:53.686318 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-140247c6-b24e-440c-89f8-039e73c1b9a6 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] Calling method '.version_select at 0x7fc90b47ad30>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:38:53.711792 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-140247c6-b24e-440c-89f8-039e73c1b9a6 tempest-TestMinimumBasicScenario-72942750 tempest-TestMinimumBasicScenario-72942750-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-942327511" status: 202 len: 0 microversion: 2.1 time: 0.029751 Sep 02 05:38:53.712424 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 721/1442] 10.222.0.30 () {58 vars in 1269 bytes} [Fri Sep 2 05:38:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-942327511 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 05:39:35.183593 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:39:35.184359 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-7856b03f-346c-4886-b008-4c99d85c71c9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:39:35.184821 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG dbcounter [-] [120448] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:39:35.185725 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-7856b03f-346c-4886-b008-4c99d85c71c9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b1aa5cbd-af79-4606-8187-fb835b9bb05d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:39:35.188517 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_api:SELECT=18 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:39:35.189193 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-677a5a9f-d701-41a7-aa98-51d7ffe28862 req-27b78c8b-16ca-4fb3-963c-aedcd8bc7fdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1aa5cbd-af79-4606-8187-fb835b9bb05d", "tag": "9ba8d95a-48ba-4500-9ac5-d13d29cf26c1"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:39:35.189350 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG dbcounter [-] [120449] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=120449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:39:35.195580 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7856b03f-346c-4886-b008-4c99d85c71c9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:39:35.196468 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7856b03f-346c-4886-b008-4c99d85c71c9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:39:35.197008 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7856b03f-346c-4886-b008-4c99d85c71c9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:39:35.197866 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7856b03f-346c-4886-b008-4c99d85c71c9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:39:35.198475 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7856b03f-346c-4886-b008-4c99d85c71c9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:39:35.198980 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-7856b03f-346c-4886-b008-4c99d85c71c9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:39:35.202144 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-677a5a9f-d701-41a7-aa98-51d7ffe28862 req-27b78c8b-16ca-4fb3-963c-aedcd8bc7fdc service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:39:35.202763 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-677a5a9f-d701-41a7-aa98-51d7ffe28862 req-27b78c8b-16ca-4fb3-963c-aedcd8bc7fdc service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:39:35.203295 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-677a5a9f-d701-41a7-aa98-51d7ffe28862 req-27b78c8b-16ca-4fb3-963c-aedcd8bc7fdc service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:39:35.216462 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-677a5a9f-d701-41a7-aa98-51d7ffe28862 req-27b78c8b-16ca-4fb3-963c-aedcd8bc7fdc service nova] Creating event network-changed:9ba8d95a-48ba-4500-9ac5-d13d29cf26c1 for instance b1aa5cbd-af79-4606-8187-fb835b9bb05d on hv-cinder-85391 Sep 02 05:39:35.222332 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-677a5a9f-d701-41a7-aa98-51d7ffe28862 req-27b78c8b-16ca-4fb3-963c-aedcd8bc7fdc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040517 Sep 02 05:39:35.223159 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 722/1443] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 05:39:35.228665 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-7856b03f-346c-4886-b008-4c99d85c71c9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b1aa5cbd-af79-4606-8187-fb835b9bb05d] Going to try to terminate instance {{(pid=120449) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 05:39:35.319513 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-7856b03f-346c-4886-b008-4c99d85c71c9 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d" status: 204 len: 0 microversion: 2.1 time: 0.138519 Sep 02 05:39:35.321078 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 722/1444] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Sep 2 05:39:35 2022] DELETE /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 05:39:35.332758 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-b82f8fb3-23b9-4c7e-a111-b2cc3501ef62 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:39:35.333523 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-b82f8fb3-23b9-4c7e-a111-b2cc3501ef62 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b1aa5cbd-af79-4606-8187-fb835b9bb05d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:39:35.339758 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b82f8fb3-23b9-4c7e-a111-b2cc3501ef62 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:39:35.340346 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b82f8fb3-23b9-4c7e-a111-b2cc3501ef62 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:39:35.340838 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b82f8fb3-23b9-4c7e-a111-b2cc3501ef62 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:39:35.341526 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b82f8fb3-23b9-4c7e-a111-b2cc3501ef62 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:39:35.341977 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b82f8fb3-23b9-4c7e-a111-b2cc3501ef62 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:39:35.342392 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-b82f8fb3-23b9-4c7e-a111-b2cc3501ef62 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:39:35.474287 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-b82f8fb3-23b9-4c7e-a111-b2cc3501ef62 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:39:35.482784 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-b82f8fb3-23b9-4c7e-a111-b2cc3501ef62 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d" status: 200 len: 1576 microversion: 2.1 time: 0.156243 Sep 02 05:39:35.483377 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 723/1445] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:39:35 2022] GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:39:36.506210 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-0ee6201c-dc47-4195-9bdc-b511495daaa2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:39:36.506820 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-0ee6201c-dc47-4195-9bdc-b511495daaa2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b1aa5cbd-af79-4606-8187-fb835b9bb05d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:39:36.514636 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0ee6201c-dc47-4195-9bdc-b511495daaa2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:39:36.515117 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0ee6201c-dc47-4195-9bdc-b511495daaa2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:39:36.515658 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0ee6201c-dc47-4195-9bdc-b511495daaa2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:39:36.516442 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0ee6201c-dc47-4195-9bdc-b511495daaa2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:39:36.516886 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0ee6201c-dc47-4195-9bdc-b511495daaa2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:39:36.517312 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-0ee6201c-dc47-4195-9bdc-b511495daaa2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:39:36.660243 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-0ee6201c-dc47-4195-9bdc-b511495daaa2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:39:36.668259 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-0ee6201c-dc47-4195-9bdc-b511495daaa2 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d" status: 200 len: 1576 microversion: 2.1 time: 0.167020 Sep 02 05:39:36.668834 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 723/1446] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:39:36 2022] GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:39:37.689518 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-25089ac1-def5-4d38-8475-ef79666a0251 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:39:37.690245 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-25089ac1-def5-4d38-8475-ef79666a0251 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b1aa5cbd-af79-4606-8187-fb835b9bb05d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:39:37.696954 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-25089ac1-def5-4d38-8475-ef79666a0251 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:39:37.697882 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-25089ac1-def5-4d38-8475-ef79666a0251 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:39:37.698089 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-25089ac1-def5-4d38-8475-ef79666a0251 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:39:37.698930 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-25089ac1-def5-4d38-8475-ef79666a0251 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:39:37.699438 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-25089ac1-def5-4d38-8475-ef79666a0251 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:39:37.699906 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-25089ac1-def5-4d38-8475-ef79666a0251 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:39:37.766162 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-25089ac1-def5-4d38-8475-ef79666a0251 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:39:37.768205 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-0b91e4b2-ea96-479e-bdb4-a3699a39e1f4 req-076253f9-d061-4eed-a3b5-167ae0acaf2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1aa5cbd-af79-4606-8187-fb835b9bb05d", "name": "network-vif-deleted", "tag": "9ba8d95a-48ba-4500-9ac5-d13d29cf26c1"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:39:37.775255 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-25089ac1-def5-4d38-8475-ef79666a0251 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d" status: 200 len: 1390 microversion: 2.1 time: 0.089735 Sep 02 05:39:37.776095 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 724/1447] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:39:37 2022] GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:39:37.782434 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-0b91e4b2-ea96-479e-bdb4-a3699a39e1f4 req-076253f9-d061-4eed-a3b5-167ae0acaf2c service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:39:37.782966 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-0b91e4b2-ea96-479e-bdb4-a3699a39e1f4 req-076253f9-d061-4eed-a3b5-167ae0acaf2c service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:39:37.783387 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-0b91e4b2-ea96-479e-bdb4-a3699a39e1f4 req-076253f9-d061-4eed-a3b5-167ae0acaf2c service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:39:37.794852 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-0b91e4b2-ea96-479e-bdb4-a3699a39e1f4 req-076253f9-d061-4eed-a3b5-167ae0acaf2c service nova] Creating event network-vif-deleted:9ba8d95a-48ba-4500-9ac5-d13d29cf26c1 for instance b1aa5cbd-af79-4606-8187-fb835b9bb05d on hv-cinder-85391 Sep 02 05:39:37.799723 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-0b91e4b2-ea96-479e-bdb4-a3699a39e1f4 req-076253f9-d061-4eed-a3b5-167ae0acaf2c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035839 Sep 02 05:39:37.800322 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 724/1448] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 05:39:38.800579 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-cad3c9ef-ad87-4c0d-8cc6-5013c73c2b70 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:39:38.801557 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-cad3c9ef-ad87-4c0d-8cc6-5013c73c2b70 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b1aa5cbd-af79-4606-8187-fb835b9bb05d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:39:38.812015 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cad3c9ef-ad87-4c0d-8cc6-5013c73c2b70 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:39:38.812508 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cad3c9ef-ad87-4c0d-8cc6-5013c73c2b70 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:39:38.812936 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cad3c9ef-ad87-4c0d-8cc6-5013c73c2b70 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:39:38.813604 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cad3c9ef-ad87-4c0d-8cc6-5013c73c2b70 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:39:38.814046 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cad3c9ef-ad87-4c0d-8cc6-5013c73c2b70 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:39:38.814456 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-cad3c9ef-ad87-4c0d-8cc6-5013c73c2b70 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:39:38.828069 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.wsgi [None req-cad3c9ef-ad87-4c0d-8cc6-5013c73c2b70 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] HTTP exception thrown: Instance b1aa5cbd-af79-4606-8187-fb835b9bb05d could not be found. Sep 02 05:39:38.829748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-cad3c9ef-ad87-4c0d-8cc6-5013c73c2b70 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Request method failure captured: Sep 02 05:39:38.829748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: request: GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d HTTP/1.1 Sep 02 05:39:38.829748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept: application/json Sep 02 05:39:38.829748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept-Encoding: identity Sep 02 05:39:38.829748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Connection: close Sep 02 05:39:38.829748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Length: 0 Sep 02 05:39:38.829748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Type: application/json Sep 02 05:39:38.829748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Host: 10.222.0.30 Sep 02 05:39:38.829748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Openstack-System-Scope: None Sep 02 05:39:38.829748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: User-Agent: python-urllib3/1.26.12 Sep 02 05:39:38.829748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Auth-Token: gAAAAABjEZSTBTGQ3NVB1DgFqU7aDU3PsJl1eB73xA8C4sxX3Yzp9lN9q4Fn1_6VUb5VftvaMOi3pv9-9CAFhNSwB5989aAkyvaKPJ08dIfAo3VdsYLWahXv8rquD4ZDiyEsYVfIw8YUO0D8djrMRmc4NOuY87Hl-VGfm5xDUAOdU04XyvTT_eE Sep 02 05:39:38.829748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Id: None Sep 02 05:39:38.829748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Name: None Sep 02 05:39:38.829748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Identity-Status: Confirmed Sep 02 05:39:38.829748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Is-Admin-Project: True Sep 02 05:39:38.829748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Id: default Sep 02 05:39:38.829748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Name: Default Sep 02 05:39:38.829748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Id: e45a42292fe94dccaa14ba6bc41ded09 Sep 02 05:39:38.829748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Name: tempest-TestVolumeBootPattern-1103430737 Sep 02 05:39:38.829748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Role: member,reader Sep 02 05:39:38.829748 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Roles: member,reader Sep 02 05:39:38.831521 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e45a42292fe94dccaa14ba6bc41ded09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45a42292fe94dccaa14ba6bc41ded09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e45a42292fe94dccaa14ba6bc41ded09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45a42292fe94dccaa14ba6bc41ded09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:39:38.831521 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant: tempest-TestVolumeBootPattern-1103430737 Sep 02 05:39:38.831521 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Id: e45a42292fe94dccaa14ba6bc41ded09 Sep 02 05:39:38.831521 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Name: tempest-TestVolumeBootPattern-1103430737 Sep 02 05:39:38.831521 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User: tempest-TestVolumeBootPattern-1103430737-project Sep 02 05:39:38.831521 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Id: default Sep 02 05:39:38.831521 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Name: Default Sep 02 05:39:38.831521 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Id: 03812cff7628436f952ea5be41420297 Sep 02 05:39:38.831521 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Name: tempest-TestVolumeBootPattern-1103430737-project Sep 02 05:39:38.831521 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: method: > Sep 02 05:39:38.831521 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: exception: Instance b1aa5cbd-af79-4606-8187-fb835b9bb05d could not be found. Sep 02 05:39:38.831521 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: action_args: {'id': 'b1aa5cbd-af79-4606-8187-fb835b9bb05d'} Sep 02 05:39:38.832672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:39:38.832672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:39:38.832672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:39:38.832672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:39:38.832672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:39:38.832672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:39:38.832672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:39:38.832672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:39:38.832672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:39:38.832672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:39:38.832672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1aa5cbd-af79-4606-8187-fb835b9bb05d could not be found. Sep 02 05:39:38.832672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:39:38.832672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:39:38.832672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:39:38.832672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:39:38.832672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:39:38.832672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:39:38.832672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:39:38.832672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:39:38.832672 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:39:38.834407 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:39:38.834407 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:39:38.834407 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:39:38.834407 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:39:38.834407 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:39:38.834407 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:39:38.834407 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:39:38.834407 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1aa5cbd-af79-4606-8187-fb835b9bb05d could not be found. Sep 02 05:39:38.834407 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:39:38.834407 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:39:38.834407 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:39:38.834407 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:39:38.834407 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:39:38.834407 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:39:38.834407 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:39:38.834407 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:39:38.834407 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1aa5cbd-af79-4606-8187-fb835b9bb05d could not be found. Sep 02 05:39:38.834407 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:39:38.836295 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-cad3c9ef-ad87-4c0d-8cc6-5013c73c2b70 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Returning 404 to user: Instance b1aa5cbd-af79-4606-8187-fb835b9bb05d could not be found. {{(pid=120448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:39:38.836295 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-cad3c9ef-ad87-4c0d-8cc6-5013c73c2b70 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d" status: 404 len: 111 microversion: 2.1 time: 0.037093 Sep 02 05:39:38.836295 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 725/1449] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:39:38 2022] GET /compute/v2.1/servers/b1aa5cbd-af79-4606-8187-fb835b9bb05d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:39:41.975831 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-37980cf7-546e-4a47-9da4-eef35f41176c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:39:41.976605 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-37980cf7-546e-4a47-9da4-eef35f41176c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: 7b97865b-0582-4cf4-a4a7-d7aaa655251d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:39:41.991521 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-37980cf7-546e-4a47-9da4-eef35f41176c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:39:41.997605 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-37980cf7-546e-4a47-9da4-eef35f41176c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:39:41.998173 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-37980cf7-546e-4a47-9da4-eef35f41176c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:39:41.999153 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-37980cf7-546e-4a47-9da4-eef35f41176c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:39:41.999706 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-37980cf7-546e-4a47-9da4-eef35f41176c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:39:42.000273 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-37980cf7-546e-4a47-9da4-eef35f41176c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:39:42.029174 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-37980cf7-546e-4a47-9da4-eef35f41176c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: 7b97865b-0582-4cf4-a4a7-d7aaa655251d] Going to try to terminate instance {{(pid=120449) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 05:39:42.118123 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-37980cf7-546e-4a47-9da4-eef35f41176c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d" status: 204 len: 0 microversion: 2.1 time: 0.146291 Sep 02 05:39:42.119102 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 725/1450] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Sep 2 05:39:41 2022] DELETE /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 05:39:42.128190 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-c1ab4457-4971-4cc0-9a6f-4fe2b976b59d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:39:42.128940 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-c1ab4457-4971-4cc0-9a6f-4fe2b976b59d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: 7b97865b-0582-4cf4-a4a7-d7aaa655251d] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:39:42.135803 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c1ab4457-4971-4cc0-9a6f-4fe2b976b59d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:39:42.136334 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c1ab4457-4971-4cc0-9a6f-4fe2b976b59d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:39:42.137253 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c1ab4457-4971-4cc0-9a6f-4fe2b976b59d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:39:42.137444 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c1ab4457-4971-4cc0-9a6f-4fe2b976b59d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:39:42.137873 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c1ab4457-4971-4cc0-9a6f-4fe2b976b59d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:39:42.138309 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-c1ab4457-4971-4cc0-9a6f-4fe2b976b59d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:39:42.193569 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [req-f1329303-32ec-4887-b5db-7e63a8bce2a1 req-58e0b26a-3831-4c8c-a737-efeb1a43cf8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b97865b-0582-4cf4-a4a7-d7aaa655251d", "tag": "5143e5e1-5d0c-40d4-854f-4a447b64972c"}]} {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:39:42.203683 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-f1329303-32ec-4887-b5db-7e63a8bce2a1 req-58e0b26a-3831-4c8c-a737-efeb1a43cf8e service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:39:42.204546 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-f1329303-32ec-4887-b5db-7e63a8bce2a1 req-58e0b26a-3831-4c8c-a737-efeb1a43cf8e service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:39:42.205076 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [req-f1329303-32ec-4887-b5db-7e63a8bce2a1 req-58e0b26a-3831-4c8c-a737-efeb1a43cf8e service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:39:42.216515 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.compute.server_external_events [req-f1329303-32ec-4887-b5db-7e63a8bce2a1 req-58e0b26a-3831-4c8c-a737-efeb1a43cf8e service nova] Creating event network-changed:5143e5e1-5d0c-40d4-854f-4a447b64972c for instance 7b97865b-0582-4cf4-a4a7-d7aaa655251d on hv-cinder-85391 Sep 02 05:39:42.222284 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [req-f1329303-32ec-4887-b5db-7e63a8bce2a1 req-58e0b26a-3831-4c8c-a737-efeb1a43cf8e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.249028 Sep 02 05:39:42.222985 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 726/1451] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:39:42.274432 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.policy [None req-c1ab4457-4971-4cc0-9a6f-4fe2b976b59d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120449) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:39:42.282605 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-c1ab4457-4971-4cc0-9a6f-4fe2b976b59d tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d" status: 200 len: 1575 microversion: 2.1 time: 0.159248 Sep 02 05:39:42.283191 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 726/1452] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:39:42 2022] GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:39:43.303742 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-966ca6a1-1398-47c6-8847-7b99288baafd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:39:43.304532 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-966ca6a1-1398-47c6-8847-7b99288baafd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: 7b97865b-0582-4cf4-a4a7-d7aaa655251d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:39:43.312978 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-966ca6a1-1398-47c6-8847-7b99288baafd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:39:43.313459 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-966ca6a1-1398-47c6-8847-7b99288baafd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:39:43.313892 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-966ca6a1-1398-47c6-8847-7b99288baafd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:39:43.315305 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-966ca6a1-1398-47c6-8847-7b99288baafd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:39:43.316148 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-966ca6a1-1398-47c6-8847-7b99288baafd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:39:43.316946 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-966ca6a1-1398-47c6-8847-7b99288baafd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:39:43.455749 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.policy [None req-966ca6a1-1398-47c6-8847-7b99288baafd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03812cff7628436f952ea5be41420297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45a42292fe94dccaa14ba6bc41ded09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120448) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 05:39:43.463767 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-966ca6a1-1398-47c6-8847-7b99288baafd tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d" status: 200 len: 1575 microversion: 2.1 time: 0.164369 Sep 02 05:39:43.464329 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 727/1453] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:39:43 2022] GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 05:39:43.619302 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [req-01060cf5-98f4-42be-a075-5a305a3f5e94 req-a21d638b-314e-4b7b-847d-149b7354b376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b97865b-0582-4cf4-a4a7-d7aaa655251d", "name": "network-vif-deleted", "tag": "5143e5e1-5d0c-40d4-854f-4a447b64972c"}]} {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 05:39:43.629038 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-01060cf5-98f4-42be-a075-5a305a3f5e94 req-a21d638b-314e-4b7b-847d-149b7354b376 service nova] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:39:43.629503 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-01060cf5-98f4-42be-a075-5a305a3f5e94 req-a21d638b-314e-4b7b-847d-149b7354b376 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:39:43.629925 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [req-01060cf5-98f4-42be-a075-5a305a3f5e94 req-a21d638b-314e-4b7b-847d-149b7354b376 service nova] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:39:43.645360 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.compute.server_external_events [req-01060cf5-98f4-42be-a075-5a305a3f5e94 req-a21d638b-314e-4b7b-847d-149b7354b376 service nova] Creating event network-vif-deleted:5143e5e1-5d0c-40d4-854f-4a447b64972c for instance 7b97865b-0582-4cf4-a4a7-d7aaa655251d on hv-cinder-85391 Sep 02 05:39:43.651990 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [req-01060cf5-98f4-42be-a075-5a305a3f5e94 req-a21d638b-314e-4b7b-847d-149b7354b376 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036236 Sep 02 05:39:43.652836 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 727/1454] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Sep 2 05:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 05:39:44.484575 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-22986abc-3074-41f4-a5b8-18cadbac73db tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:39:44.485272 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-22986abc-3074-41f4-a5b8-18cadbac73db tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: 7b97865b-0582-4cf4-a4a7-d7aaa655251d] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:39:44.492265 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-22986abc-3074-41f4-a5b8-18cadbac73db tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:39:44.492761 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-22986abc-3074-41f4-a5b8-18cadbac73db tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:39:44.493195 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-22986abc-3074-41f4-a5b8-18cadbac73db tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:39:44.493893 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-22986abc-3074-41f4-a5b8-18cadbac73db tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:39:44.494332 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-22986abc-3074-41f4-a5b8-18cadbac73db tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:39:44.494767 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-22986abc-3074-41f4-a5b8-18cadbac73db tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:39:44.508629 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.wsgi [None req-22986abc-3074-41f4-a5b8-18cadbac73db tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] HTTP exception thrown: Instance 7b97865b-0582-4cf4-a4a7-d7aaa655251d could not be found. Sep 02 05:39:44.510307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-22986abc-3074-41f4-a5b8-18cadbac73db tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Request method failure captured: Sep 02 05:39:44.510307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: request: GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d HTTP/1.1 Sep 02 05:39:44.510307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept: application/json Sep 02 05:39:44.510307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept-Encoding: identity Sep 02 05:39:44.510307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Connection: close Sep 02 05:39:44.510307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Length: 0 Sep 02 05:39:44.510307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Type: application/json Sep 02 05:39:44.510307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Host: 10.222.0.30 Sep 02 05:39:44.510307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Openstack-System-Scope: None Sep 02 05:39:44.510307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: User-Agent: python-urllib3/1.26.12 Sep 02 05:39:44.510307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Auth-Token: gAAAAABjEZSTBTGQ3NVB1DgFqU7aDU3PsJl1eB73xA8C4sxX3Yzp9lN9q4Fn1_6VUb5VftvaMOi3pv9-9CAFhNSwB5989aAkyvaKPJ08dIfAo3VdsYLWahXv8rquD4ZDiyEsYVfIw8YUO0D8djrMRmc4NOuY87Hl-VGfm5xDUAOdU04XyvTT_eE Sep 02 05:39:44.510307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Id: None Sep 02 05:39:44.510307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Name: None Sep 02 05:39:44.510307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Identity-Status: Confirmed Sep 02 05:39:44.510307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Is-Admin-Project: True Sep 02 05:39:44.510307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Id: default Sep 02 05:39:44.510307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Name: Default Sep 02 05:39:44.510307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Id: e45a42292fe94dccaa14ba6bc41ded09 Sep 02 05:39:44.510307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Name: tempest-TestVolumeBootPattern-1103430737 Sep 02 05:39:44.510307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Role: member,reader Sep 02 05:39:44.510307 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Roles: member,reader Sep 02 05:39:44.512040 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e45a42292fe94dccaa14ba6bc41ded09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45a42292fe94dccaa14ba6bc41ded09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e45a42292fe94dccaa14ba6bc41ded09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45a42292fe94dccaa14ba6bc41ded09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:39:44.512040 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant: tempest-TestVolumeBootPattern-1103430737 Sep 02 05:39:44.512040 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Id: e45a42292fe94dccaa14ba6bc41ded09 Sep 02 05:39:44.512040 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Name: tempest-TestVolumeBootPattern-1103430737 Sep 02 05:39:44.512040 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User: tempest-TestVolumeBootPattern-1103430737-project Sep 02 05:39:44.512040 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Id: default Sep 02 05:39:44.512040 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Name: Default Sep 02 05:39:44.512040 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Id: 03812cff7628436f952ea5be41420297 Sep 02 05:39:44.512040 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Name: tempest-TestVolumeBootPattern-1103430737-project Sep 02 05:39:44.512040 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: method: > Sep 02 05:39:44.512040 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: exception: Instance 7b97865b-0582-4cf4-a4a7-d7aaa655251d could not be found. Sep 02 05:39:44.512040 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: action_args: {'id': '7b97865b-0582-4cf4-a4a7-d7aaa655251d'} Sep 02 05:39:44.513000 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:39:44.513000 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:39:44.513000 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:39:44.513000 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:39:44.513000 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:39:44.513000 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:39:44.513000 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:39:44.513000 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:39:44.513000 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:39:44.513000 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:39:44.513000 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b97865b-0582-4cf4-a4a7-d7aaa655251d could not be found. Sep 02 05:39:44.513000 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:39:44.513000 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:39:44.513000 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:39:44.513000 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:39:44.513000 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:39:44.513000 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:39:44.513000 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:39:44.513000 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:39:44.513000 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:39:44.514682 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:39:44.514682 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:39:44.514682 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:39:44.514682 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:39:44.514682 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:39:44.514682 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:39:44.514682 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:39:44.514682 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b97865b-0582-4cf4-a4a7-d7aaa655251d could not be found. Sep 02 05:39:44.514682 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:39:44.514682 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:39:44.514682 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:39:44.514682 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:39:44.514682 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:39:44.514682 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:39:44.514682 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:39:44.514682 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:39:44.514682 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b97865b-0582-4cf4-a4a7-d7aaa655251d could not be found. Sep 02 05:39:44.514682 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:39:44.516372 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-22986abc-3074-41f4-a5b8-18cadbac73db tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Returning 404 to user: Instance 7b97865b-0582-4cf4-a4a7-d7aaa655251d could not be found. {{(pid=120448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:39:44.516372 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-22986abc-3074-41f4-a5b8-18cadbac73db tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d" status: 404 len: 111 microversion: 2.1 time: 0.031427 Sep 02 05:39:44.516372 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 728/1455] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:39:44 2022] GET /compute/v2.1/servers/7b97865b-0582-4cf4-a4a7-d7aaa655251d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:39:45.261062 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-dc7a532f-4022-401c-ad06-4bfce6b41121 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:39:45.261675 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.compute.api [None req-dc7a532f-4022-401c-ad06-4bfce6b41121 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120449) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:39:45.268012 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dc7a532f-4022-401c-ad06-4bfce6b41121 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:39:45.268542 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dc7a532f-4022-401c-ad06-4bfce6b41121 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:39:45.268945 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dc7a532f-4022-401c-ad06-4bfce6b41121 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:39:45.269658 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dc7a532f-4022-401c-ad06-4bfce6b41121 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:39:45.270096 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dc7a532f-4022-401c-ad06-4bfce6b41121 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:39:45.270510 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG oslo_concurrency.lockutils [None req-dc7a532f-4022-401c-ad06-4bfce6b41121 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:39:45.283956 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.wsgi [None req-dc7a532f-4022-401c-ad06-4bfce6b41121 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] HTTP exception thrown: Instance b554b98c-26dd-444a-9b8b-9c2a887babb4 could not be found. Sep 02 05:39:45.286460 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-dc7a532f-4022-401c-ad06-4bfce6b41121 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Request method failure captured: Sep 02 05:39:45.286460 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: request: DELETE /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 HTTP/1.1 Sep 02 05:39:45.286460 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept: application/json Sep 02 05:39:45.286460 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Accept-Encoding: identity Sep 02 05:39:45.286460 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Connection: close Sep 02 05:39:45.286460 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Length: 0 Sep 02 05:39:45.286460 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Content-Type: application/json Sep 02 05:39:45.286460 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Host: 10.222.0.30 Sep 02 05:39:45.286460 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: Openstack-System-Scope: None Sep 02 05:39:45.286460 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: User-Agent: python-urllib3/1.26.12 Sep 02 05:39:45.286460 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Auth-Token: gAAAAABjEZSTBTGQ3NVB1DgFqU7aDU3PsJl1eB73xA8C4sxX3Yzp9lN9q4Fn1_6VUb5VftvaMOi3pv9-9CAFhNSwB5989aAkyvaKPJ08dIfAo3VdsYLWahXv8rquD4ZDiyEsYVfIw8YUO0D8djrMRmc4NOuY87Hl-VGfm5xDUAOdU04XyvTT_eE Sep 02 05:39:45.286460 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Id: None Sep 02 05:39:45.286460 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Domain-Name: None Sep 02 05:39:45.286460 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Identity-Status: Confirmed Sep 02 05:39:45.286460 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Is-Admin-Project: True Sep 02 05:39:45.286460 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Id: default Sep 02 05:39:45.286460 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Domain-Name: Default Sep 02 05:39:45.286460 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Id: e45a42292fe94dccaa14ba6bc41ded09 Sep 02 05:39:45.286460 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Project-Name: tempest-TestVolumeBootPattern-1103430737 Sep 02 05:39:45.286460 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Role: member,reader Sep 02 05:39:45.286460 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Roles: member,reader Sep 02 05:39:45.288291 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e45a42292fe94dccaa14ba6bc41ded09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45a42292fe94dccaa14ba6bc41ded09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e45a42292fe94dccaa14ba6bc41ded09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45a42292fe94dccaa14ba6bc41ded09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:39:45.288291 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant: tempest-TestVolumeBootPattern-1103430737 Sep 02 05:39:45.288291 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Id: e45a42292fe94dccaa14ba6bc41ded09 Sep 02 05:39:45.288291 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-Tenant-Name: tempest-TestVolumeBootPattern-1103430737 Sep 02 05:39:45.288291 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User: tempest-TestVolumeBootPattern-1103430737-project Sep 02 05:39:45.288291 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Id: default Sep 02 05:39:45.288291 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Domain-Name: Default Sep 02 05:39:45.288291 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Id: 03812cff7628436f952ea5be41420297 Sep 02 05:39:45.288291 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: X-User-Name: tempest-TestVolumeBootPattern-1103430737-project Sep 02 05:39:45.288291 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: method: > Sep 02 05:39:45.288291 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: exception: Instance b554b98c-26dd-444a-9b8b-9c2a887babb4 could not be found. Sep 02 05:39:45.288291 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: action_args: {'id': 'b554b98c-26dd-444a-9b8b-9c2a887babb4'} Sep 02 05:39:45.289771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:39:45.289771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:39:45.289771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:39:45.289771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:39:45.289771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:39:45.289771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:39:45.289771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:39:45.289771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:39:45.289771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:39:45.289771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:39:45.289771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b554b98c-26dd-444a-9b8b-9c2a887babb4 could not be found. Sep 02 05:39:45.289771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:39:45.289771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:39:45.289771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:39:45.289771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:39:45.289771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:39:45.289771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:39:45.289771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:39:45.289771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:39:45.289771 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:39:45.291741 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:39:45.291741 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 05:39:45.291741 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 05:39:45.291741 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 05:39:45.291741 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 05:39:45.291741 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:39:45.291741 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:39:45.291741 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:39:45.291741 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:39:45.291741 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b554b98c-26dd-444a-9b8b-9c2a887babb4 could not be found. Sep 02 05:39:45.291741 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:39:45.291741 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:39:45.291741 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:39:45.291741 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:39:45.291741 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:39:45.291741 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:39:45.291741 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:39:45.291741 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:39:45.291741 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b554b98c-26dd-444a-9b8b-9c2a887babb4 could not be found. Sep 02 05:39:45.291741 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR nova.api.openstack.wsgi Sep 02 05:39:45.293753 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-dc7a532f-4022-401c-ad06-4bfce6b41121 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Returning 404 to user: Instance b554b98c-26dd-444a-9b8b-9c2a887babb4 could not be found. {{(pid=120449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:39:45.293753 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-dc7a532f-4022-401c-ad06-4bfce6b41121 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 404 len: 111 microversion: 2.1 time: 0.030925 Sep 02 05:39:45.293753 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 728/1456] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Sep 2 05:39:45 2022] DELETE /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:39:45.296595 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d96be200-5c0a-4395-af13-0767eba2140c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '>' {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:39:45.297222 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.compute.api [None req-d96be200-5c0a-4395-af13-0767eba2140c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [instance: b554b98c-26dd-444a-9b8b-9c2a887babb4] Fetching instance by UUID {{(pid=120448) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 05:39:45.303619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d96be200-5c0a-4395-af13-0767eba2140c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:39:45.304084 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d96be200-5c0a-4395-af13-0767eba2140c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:39:45.304571 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d96be200-5c0a-4395-af13-0767eba2140c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:39:45.305260 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d96be200-5c0a-4395-af13-0767eba2140c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Acquiring lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 05:39:45.305708 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d96be200-5c0a-4395-af13-0767eba2140c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 05:39:45.306129 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG oslo_concurrency.lockutils [None req-d96be200-5c0a-4395-af13-0767eba2140c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Lock "90ca4909-2326-46fd-b0af-6442bf8c1fe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 05:39:45.321777 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.wsgi [None req-d96be200-5c0a-4395-af13-0767eba2140c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] HTTP exception thrown: Instance b554b98c-26dd-444a-9b8b-9c2a887babb4 could not be found. Sep 02 05:39:45.323281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d96be200-5c0a-4395-af13-0767eba2140c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Request method failure captured: Sep 02 05:39:45.323281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: request: GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 HTTP/1.1 Sep 02 05:39:45.323281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept: application/json Sep 02 05:39:45.323281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Accept-Encoding: identity Sep 02 05:39:45.323281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Connection: close Sep 02 05:39:45.323281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Length: 0 Sep 02 05:39:45.323281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Content-Type: application/json Sep 02 05:39:45.323281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Host: 10.222.0.30 Sep 02 05:39:45.323281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: Openstack-System-Scope: None Sep 02 05:39:45.323281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: User-Agent: python-urllib3/1.26.12 Sep 02 05:39:45.323281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Auth-Token: gAAAAABjEZSTBTGQ3NVB1DgFqU7aDU3PsJl1eB73xA8C4sxX3Yzp9lN9q4Fn1_6VUb5VftvaMOi3pv9-9CAFhNSwB5989aAkyvaKPJ08dIfAo3VdsYLWahXv8rquD4ZDiyEsYVfIw8YUO0D8djrMRmc4NOuY87Hl-VGfm5xDUAOdU04XyvTT_eE Sep 02 05:39:45.323281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Id: None Sep 02 05:39:45.323281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Domain-Name: None Sep 02 05:39:45.323281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Identity-Status: Confirmed Sep 02 05:39:45.323281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Is-Admin-Project: True Sep 02 05:39:45.323281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Id: default Sep 02 05:39:45.323281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Domain-Name: Default Sep 02 05:39:45.323281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Id: e45a42292fe94dccaa14ba6bc41ded09 Sep 02 05:39:45.323281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Project-Name: tempest-TestVolumeBootPattern-1103430737 Sep 02 05:39:45.323281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Role: member,reader Sep 02 05:39:45.323281 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Roles: member,reader Sep 02 05:39:45.324836 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e45a42292fe94dccaa14ba6bc41ded09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45a42292fe94dccaa14ba6bc41ded09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e45a42292fe94dccaa14ba6bc41ded09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45a42292fe94dccaa14ba6bc41ded09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Sep 02 05:39:45.324836 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant: tempest-TestVolumeBootPattern-1103430737 Sep 02 05:39:45.324836 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Id: e45a42292fe94dccaa14ba6bc41ded09 Sep 02 05:39:45.324836 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-Tenant-Name: tempest-TestVolumeBootPattern-1103430737 Sep 02 05:39:45.324836 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User: tempest-TestVolumeBootPattern-1103430737-project Sep 02 05:39:45.324836 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Id: default Sep 02 05:39:45.324836 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Domain-Name: Default Sep 02 05:39:45.324836 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Id: 03812cff7628436f952ea5be41420297 Sep 02 05:39:45.324836 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: X-User-Name: tempest-TestVolumeBootPattern-1103430737-project Sep 02 05:39:45.324836 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: method: > Sep 02 05:39:45.324836 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: exception: Instance b554b98c-26dd-444a-9b8b-9c2a887babb4 could not be found. Sep 02 05:39:45.324836 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: action_args: {'id': 'b554b98c-26dd-444a-9b8b-9c2a887babb4'} Sep 02 05:39:45.325929 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: {{(pid=120448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 05:39:45.325929 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:39:45.325929 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 05:39:45.325929 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 05:39:45.325929 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 05:39:45.325929 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 05:39:45.325929 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 05:39:45.325929 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 05:39:45.325929 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 05:39:45.325929 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 05:39:45.325929 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b554b98c-26dd-444a-9b8b-9c2a887babb4 could not be found. Sep 02 05:39:45.325929 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:39:45.325929 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:39:45.325929 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:39:45.325929 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:39:45.325929 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:39:45.325929 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:39:45.325929 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 05:39:45.325929 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 05:39:45.325929 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 05:39:45.327619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 05:39:45.327619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 05:39:45.327619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 05:39:45.327619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 05:39:45.327619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 05:39:45.327619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 05:39:45.327619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 05:39:45.327619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b554b98c-26dd-444a-9b8b-9c2a887babb4 could not be found. Sep 02 05:39:45.327619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:39:45.327619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 05:39:45.327619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:39:45.327619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 05:39:45.327619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 05:39:45.327619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 05:39:45.327619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 05:39:45.327619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 05:39:45.327619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b554b98c-26dd-444a-9b8b-9c2a887babb4 could not be found. Sep 02 05:39:45.327619 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: ERROR nova.api.openstack.wsgi Sep 02 05:39:45.329260 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: DEBUG nova.api.openstack.wsgi [None req-d96be200-5c0a-4395-af13-0767eba2140c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Returning 404 to user: Instance b554b98c-26dd-444a-9b8b-9c2a887babb4 could not be found. {{(pid=120448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 05:39:45.329260 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: INFO nova.api.openstack.requestlog [None req-d96be200-5c0a-4395-af13-0767eba2140c tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4" status: 404 len: 111 microversion: 2.1 time: 0.032427 Sep 02 05:39:45.329260 dv-cinder-853910-7-iscsi devstack@n-api.service[120448]: [pid: 120448|app: 0|req: 729/1457] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Sep 2 05:39:45 2022] GET /compute/v2.1/servers/b554b98c-26dd-444a-9b8b-9c2a887babb4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 05:39:46.629428 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: DEBUG nova.api.openstack.wsgi [None req-97e48e2d-209b-479c-b15a-249ce1aa9a18 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] Calling method '.version_select at 0x7fc90b4b9e50>' {{(pid=120449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 05:39:46.633916 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: ERROR oslo.messaging._drivers.impl_rabbit [None req-97e48e2d-209b-479c-b15a-249ce1aa9a18 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [0d827ea1-3cba-488b-b42c-f7d5141c8278] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 02 05:39:47.645890 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO oslo.messaging._drivers.impl_rabbit [None req-97e48e2d-209b-479c-b15a-249ce1aa9a18 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] [0d827ea1-3cba-488b-b42c-f7d5141c8278] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 58036. Sep 02 05:39:47.674664 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: INFO nova.api.openstack.requestlog [None req-97e48e2d-209b-479c-b15a-249ce1aa9a18 tempest-TestVolumeBootPattern-1103430737 tempest-TestVolumeBootPattern-1103430737-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1280367057" status: 202 len: 0 microversion: 2.1 time: 1.049147 Sep 02 05:39:47.675292 dv-cinder-853910-7-iscsi devstack@n-api.service[120449]: [pid: 120449|app: 0|req: 729/1458] 10.222.0.30 () {58 vars in 1263 bytes} [Fri Sep 2 05:39:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1280367057 => generated 0 bytes in 1050 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)